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ABSTRACT - • j r , - 

This report presents the field tests plan including 
-site. selection for the! Basic Skill Development Through Vocational 
Education Project. (The project;' s purpose is to develop Resource and 
Teacher Guides to provide vocational and occupational education 
teachers with information about ways of incorporating ba*sic skills 
instruction into occupational education and about resources to help 
facilitate implementation of a coordinated and integrated, basic 
skills program within a vocational program/) Chapter 1 provides 
assumptions underlying "elements of the /field test plan* ; Chapter 2 
reviews development, evaluation, and revision/activities whi$h led up 
to the fitld test. Chapter 3 is /the recommended ti eld test plan 
itself .Topics covered include purpose, materials, evaluation 
criteria (usability , effectiveness, generalizab^lity) , groups . 
involved in field* testing, data collection instruments, field test 
activities (site selection, site preparation, materials usage, site 
close-out), data analysis, and timetable, five appendixes include (1) 
materials evaluation criteria, topics , and questions; * (2) 
descriptions of data collection documents; " (3) relationship between 
the documents and evaluation questions; (4) field test sites; and (5) 
draft versions of data collection instruments. The fifth appendix 
comprises approximately 75% of the report. (YLB) 
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Tfiis paper presents the "field* test plan including site selection for 
the : B'asic A Skill , Development Through Vocational Education Project which is 
being' conducted by the Cornell Institute J(or Occupational Education. 

The purpose of the project is to develop Resource and Teacher Guides 

• * 

which will provide vocational and occupational education teachers' with 

* • 

information about ways of ^incorporating basic skills instruction into 
occupational education, and about resources which will help facilitate 
implementation of a coordinated and integrated basic skills program within 
a. vocational program. Vocational education teachers could use these • 



materials to improve their students' basic skills competencies^ while they 

teach technical skills 'competencies ♦ 

■ * 

4 * • 

Once project staff have developed ptoto type- versions of the Resource 
and Teacher Guides (hereafter referred to as "guides" or "materials") the 
materials will undergo a formative evaluation by being field-tested by, a 
sample of Vocational education teachers. 

. ' * * 

Chapter One presents some of the assumptions underlying elements of 
the field test plan* Chapter Two feviews development, evaluation, and 
revision activities which lead up to the field test*| Chapter Three 
is the recommended fieia test plan itself. There are five appendices to 
this report: the field test evaluation criteria; descriptions of the 
data collection documents; the relationship between, the documents 'and 
the evaluation questions; field test g^es; and draft documents. 

Thanks* go to John Bowers for his thorough description of the fiel4 
test plan and to Judy Nichols for her expert typirig,of the .final draft 
of this paper. Special thaiciks go to Madeline Dean for typing the data 
collection document drafts in Appendix. E.' v 



James A. Dunn 
- .Principal' investigator and' 
* * J < _ . ' * Director, Cornell Institute for 

* ' * Occupational Education 
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CHAPTER ONE 
ASSUMPTIONS 



Field Test Plan (Task I) 



A very basic assumption for the field test, or any field test/ is 
■that the best way to develop a product such as the guides is to-do it 
so that the product not only reflects good theoretical Tcnowledge but also * 
the realities of the context in* which it will be used. Materials must ^ 
be tested linder real-world conditions, and be used by persons represen- 

tative of /the materials 1 in t^nd^d audience. fijeld^ test in a realistic 

situ^adion will help to show that the' guides .perform as intended under ^ 
near nonLil use in a variety of conditions and populations • This infor- 



mation x/ill help to determine* how the, lf real world 11 affects the use of 

/ # . " 

the guides. 

' It is also assumed that, to be conducted properly, ,the field test 

7 ■ ' y 

must pe guided by criteria by which the materials may be judged and that 
these criteria must be specified clearly as- part of the field test 
design. The field test is essentially a formative evaluation and evalua- 
tion must contribute, information useful for decision-making aboup materials 

/ * ■ * 

4evelopment. Data gather£ng~must-be disciplined and organized and must 

contribute, to these decisions regarding product, improvements. But deci- 
sions al£o require criteria, standards" by which to "make judgments regard- 
ing product improvements. The suggested criteria of 'usability, effective- 
ness, and gefierkliz^Bility are presented in moire detail later in this 
position paper. In Addition, Criteria for both the nomination and finai 
selection of field test sites (Task J) are discussed below. 



t Si& Selection (Task J) * 

v - * ' ' * . * 

' * * * * * 

A number of assumptions lie behind J:he recommendation "to us^^jpJA 
sites for, the field test and behind the criteria' by which such sites will 



be selected/ Sites,, ratfrer than individual teacher volunteers, are use.d 

as field test units since it is assumed that * the guides could not be used 

effectively by an individual without backing fjrom the organizational 

context and its leadership. Further, it is necessary to provide support 

and assistance to users and this is' most efficiently done by .working ^ 

with sites rather than with individuals. 

* • 

There As also an assumption that an^Drganizational chain of command 
. should be 'followed in the nomination and selection df 'Sites* This rdcog- 
nize§'the central role of state and local administrators itf initiating and 

4 1 

supporting almost any change process. Since it is assumed that it is 

desirable for the final version of guides to be used by as many teachers' 

» * 

across the country as possible, such sites must represent a geographic 
mix, varying classroom contexts reflecting differing racial, socioeconomic 
and ability groups, and differing organizational contexts. Exact criteria 
for site selection will be discussed in more detail later in this paper'. 

W • . ^ 

A ♦ 

* Field Test Coordinator Role . , . 

v ; 

m It has keen assumed that there will be a need to carry out specific 
assist^fice efforts for participating sites. It is also assumed that there 
will be a freavy data gathering and analysis burden associate^ with each _ ^ 
site if detailed usage information is to be gathered, that it would be 
better if teachers and administrators at the site were not burdened by~. 
such data .collection, and that more reliable data would be gathered by 
trained personnel. These assumptions have influenced the role of the 
Field Test Coordinator as it is presented in the recommended field test 
plan. Essentially, it is assumed that the Field Tfest Coordinator will act 
both as a facilitator who supports the entry process at a site and -the 
-adaptation and use of the .materials, and also as' an observer who*gathers 
extensive knowledge about the sites and their use of the materials. More , 
details about assumptions and actions of the Field Test Coordinator are; 
presented -in the recommended plan. j£ 



Essentially/ this role is part of the mechanism which allows more, 
responsiveness to local needs and ^conditions during materials use. It 
also provides *a way of doqumenting and communicating problems and accnom- 
plishments. The phone "hot-line 1 . 1 which ^teachers may use k £o call ^project., 
staff for assistance in .solving problems associated 'with. materials usage 
is another part of this mechanism. 



Data Collection 

* t • » 

• The need to gather accurate information about v *how teachers use and 

react °tp the guides has been a m&jor influence shaping the design .of data 

collection documents. Another influence has been the .heed to consider 

future dissemination problems of the guides. Thus, documents also gather 
> ■ ' «. • 

/data to help- analyze the school as part of a larger community, . determine . 

* teacher training needs', afid examine the network of* support of the selec;- 
tUon and usage of the guides. 

• » 

Some of the forms of the data collection documents* are designed for 
administrators and technical reviewers! Although it is assumed that 
fceactiers, as the primary users of the guides, would be the # primary source 
of information for the field test, it is not assumec} they would ^e the 
only source-; Teachers 'ma$. not always be experienced with the- total ratxge 
of issues that need to be considered in developing and disseminating 
such a product. • Administrators can provide information regarding adminis 
tratiye issues and expert reviewer? cart -make* both conceptual" and concrete 
re'commendations^for materials con tent, and usage. • 



This chapter has* attempted to outline only a few of the. assumptions 
behind the .recommendations in the field test^plan. Others arempre 
appropriately discussed "in ; the context of the field test plan in the 
ne^t* chapters. % . ** * 
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CHAPTER TWO 
ACTIVITIES PRIOR TO THE FIELD TEST 



« In his position paper on the development o^the Resource aifd Teacher 
Guides, .Gray has* outlined in some detail the activities for developing, 
producing, reviewing, and revising the materials, leading up to the pro- 1 
duction of the version of the materials to be used* during this field test. 

• In order that the reader may mor;e clearly understand the relationship of 
the field, test with previous development and evaluation activities, G^ay 1 ^^ 
development procedures, time frames, design strategy,- evaluation criteria, 
'and: production tasks are reviewed briefly below. Additional information 

is provided regarding the persons and procedures involved in the. review 
process. 

; . ' • ' \ -1 

<S s \ > Design Strategy ' t 

Development begins with an initial design strategy which ^attempts to- 

# determine *the objectives .that .teachers are to accomplish^ as a result of . 
using the guides, gathers* data about the experience, interests and prefer- 
ences of vocational education teachers, a^d creates design alternatives 
for the materials based cm both these objectives for the guides* *and the 
data about % the teachers. • Thp v clesign strategy .concludes with recommenda- 



tions -for. particular alternatives, 

< • . .•*•■ •• • 



Development Process 



After this initial design strategy, the remainder ot tb* development 
process may be viewed as a series of successive thre.e-sstep- cycles of 
materials production, materials review, and materials design ^and, r6<rii&ion. 
Production comprises manuscript preparation; artwork, ^editing and proofing, 
printing, and preparation *f or dissemination. Materials review consists of 
submitting the materials to selected reviewers for their responses to 

5 ■ • 



specific questions based on evaluation criteria, as well as their general 
comments regarding. materials improvement; Information from the' review is 
fed into the design-revision step. -This thir£| step essentially repeats 
the design strategy described -in the previous, paragraph. The recommenda- 
tions resulting? from the design strategy lead to the revision of. the 
.materials. ■ This output of the'revisedjnaterials then serves as^tihe input 
tb.the production step in the next cycle^ 

"1 • ' v • .. ." • , ' 

Gray f s proposed schedule calls for the first cycle to begin with th^ • 
production of outlines for' the guides 1 component beginning on March 10, 
the review 'of 'these components to begin on March 24, and the revision 
design cycle .to. beginT M^lrbh 27, »1980-. 

Production of the next set of materials, called the pilot trial ver- 
sion, is scheduled to begin on April 16 with the materials review beginning 
June 1 by our Project Monitor, in 'accord with our major project milestones* 

» 

' Pilot test materials are scheduled for production after June 15'. ■ 
The pilot test itself will begin on June 23,jand design and revision on 

Jixly.^S^lSBai;!.- . ■ . , f~ 



Production .of afield test materials will begin : on- August 4^and' the 
shield test will start on September 15, 1980. Plans for the evaluation 
criteria, groups, Instruments, and. activities associated with the fi^ld 
test L are the c , subject of succeeding sections of this . plan. 



"Evaluation Criteria and foufetions 



Gray has Slso^set ut> 'evaluation criteria, topfcs, and^questions 
iot^the prototype * exponent reviews, the pilot trial and pilot- test - 
versions of the materials. ' Three criteria have been specified: usabil-, 

- **** ' . , 

ity, effectiveness, and generalizability. Within each of these 



criteria -are a number of jfcopics and questions. Materials developers will 
seek answers to these evaluation questions by gathering information from 
the reviewers. • 

Gray's evaluation criteria are identical to those to be used during 
the field test. His evaluation topic? and questions are highly consis- 
tent with,- but not identical to, those to be used in interpreting field 
test results* The evaluation topics and questions for the field test are 
more extensive and detailed and are organized somewhat differently* The 
field test criteria, topics, and questions are presented in the following 
sectidn. 

^ The reviewers for the component outlines and the guides' 
pilot test versions will be selected from a lumber, of groyps. The 
reviewers will include the project's facility advisors, adjunct staff, and 
a National Advisory Committee comprised o^ experts in vocational education 
basic skills , ^product development, and educational research. ^Teacher's 
and administrators will also be asked to review the materials. Theke 
achers and administrators will probably be selected from district* with- 
New York because of their accessibility to project staff. 




The pij^t test deserves some additional comment. It is the final 
review of the materials, prior to their actual full-scale use in the class- 
room. .It .will probably* involve more reviewers than the previous reviews, 
including possibly some. from Florida where basic skills instruction is be- 
ing implemented in conjunction with vocational education. In addition, 
to the materials, reviewers will be asked to review and comment on the 
field test data collection instruments with respect to their clarity, *' 
utility, ^objectivity, ease of response,- and other factorsV Information 
f^om this pilot test can be used to refine --the materials^ the field t&st ' 



instruments and the data collection procedures prior to the. beginning of y 

■* 

the field test. * 
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CHAPTER THREE 



* FIELD TEST PLAN (TASK I) INCLUDING SITE SELECTION (TASK J) ' 



Purpose of the Field Test? 

The purpose of the field test is to gather information which cstn be 
used by the developers to improve the guides and %o provide initial infor- 
mation on. their validation. It is anticipated thkt the field test may 
also provide information which can be useful later in the dissemination 
of /"the guides. Field test information will be gathered from product users ^ 
in a variety <fi implementation contexts as well as from reviewers of the - 
materials. * 



Materials, Evaluation Criteria 

V 

Three general criteria will* be used to judge the materials* and to 
determine what, aspects of* the materials need to be improved. These three 
criteria are usability, effectiveness, and generalizability. 

■ Usability refers to the capability of the materials to be used by- 
teachers and administrators in ^a real-world getting. , Within the general 
criterion of 'usability "are the topics 6f the clarity of the materials' 
content, and illustrations, their adaptability within various school and 
classroom contexts, their ease of use, the level of resources needed to 
use them, their acceptability' to their intended audience, and the ease 
with which the procedures outlined in the materials can be integrated 
within existing school teaching and testing practices. 

** Effectiveness refers to the materials 1 potential for effectiveness 
in their intended setting/- In this'field test plan, effectiveness does 
not refer to changes in either teacher' behavior or student behavior*. 
Although such' changes may^bc cur as a result of using the materials, they 
probably would not appear in any' detectable form for some time. The 



limited nature of the £iel4 test, and especially the limited tinre avail- 
able for i-t, 'makes it necessary, as a practical matter, to restrict the 
definition' o£^ materials effectiveness to estimates of the potential . 
effectiveness of the materials.- The general criterion of . effectiveness 
here compriSes the topics of the accuracy and currency -of the materials 
content, user characteristics ,and »in-service training required for success- 
ful use. of -the materials., teacher perceptions of the materials' effec- 
tiveness, . the potential impact which users perceive that the materials may 
have on instruction, the* perceived value of the materials with respect 
to' the needs of school personnel, their attractiveness, the extent to 
.which the materials are perceived »as excluding or countering racial and 
sexual bias, the variability of the perceived effectiveness in various 
contexts, and any unintended effects which result from materials 1 use* 

Generalizability^ l&ef ers to the capability of- the materials to be 
disseminated to an<£ useo^in other sites than those in the field test. 
However, such judgments will be b&sed on the experience of using the 
materials in the field test sites. Within the criterion of general!- 

^zability are such topic§_ajs user interest, costs o£ using the materials, 
and the perceived adequacy of the materials for use with special needs 

• students and adults. • « fc • 



Within each of these criteria ^and topics, there are a number, of. 

-specific evaluation questions. Because of their large number, these 

evaluation' questions, organized by* criterion and topic, 'are listed in *• 

. Appendix A. It is these questions- which tke developers must ask* them- 
. .. * * -.j** 

selves, and answer,, in order to improve the materials. Answers to these 

questions will enable developers to assess the quality of- the field test # 

versions of the. guides and .specify? those character is tics_-which- need ■ 

improvements" These questions will not be asked directly of the field test 

f » r * 

participants 'in the form* .stated in* Appendix A. Rather, they will be 
elaborated into a series of items' to be presented to participating groups 

'\ 10 .' • 



on various documents 1 / "* By examining and aaalyzing^fehe responses from 
these individuals, pro^efct evaluators and- deVelopers>vwiU be able to 
derive answers' to the' more general evaluation qu$s,tid&s Xn Appendix 
The^ developers will use tfce answer^ to s t^ese general, evaluation .questions 
1 in revising the guides for dissemination. ~ ' r 



a x s a major too 



\ 



Groups Involved in Field Testing' 



In addition, to *t#*e product developers, there ate foux; major groups 
from whom' data will be collected in the field test. 

■ teachers are the first, and primary, group fronl whom field test data 
will be. collected. Secondary vocational education teachers are intended 
to be the primary -users of the final -versions of the guides. They will 
be the chie*f source -of information about the usability, effectiveness, 
and generalizability of the materials. It is planned that 'there will be 
approximately four to six sites in each of the six states ♦ Assuming that 
thfere will be an Average of about eight -teachers per site, it is there- 
fore estimated that data will.be collected from about 192, to 28a teachers 
For planning purposes, a totai of about 240 .teachers^ill be assumed. 

Administrators , the second* group, include any state or local voca- 
tional education administrator who is associated with the use of the 
materials' in 1 * site but who does not actually use them in the classroom. 
Review by such persons wttjL assure that the materials .represent current 
thinking in vocational education, reflect local and state priorities, 
and*\ire practical -from an administrative point of view. An estimated 
30* persons will be in this group. " „ , 

technical reviewers the third group", will' 'be selected for their 
experience with basic skills or vocational education, or their* experience 
in^ materials development. The group comprises adjunct staffs faculty 



advisors, and an advisory committee associated with the project, - About* 
25 persons will be in this group. * s 

i « 

; ; . Field Test Coordinators , the fourth grpup, will be a major source of 

•data through their work with teachers at participating sites antf their • 
observations of .materials usage,. There are four Field Test Coordinators 

"employed "by the. project, each assigned to one or two states • These persons 
perform a crucial role in the project. They will facilitate the use dfc 
the .products in the pites by gaining the cooperation of the teachers, by 

.providing training in-. the use^ of the materials, by providing concrete 
assistance on immediate p*roblems in the use of the materials, by developing 
support in" the local sit£ for the use o£ the materials, and by gathering, 
Analyzing, and reporting, data regarding: the sites 1 ' usage of the materials. 



Data Collection^ Documents ' - 

. ' . A . ' 

• A number of documents* and data .collection methods will be used, to* 
gather information regarding the evaluation criteria, 4 topics, and ques- - 
tions outlined, in Appendix A. Documents have been devised in such a way 
that each evaluation topic is assessed by at least one item on at least ■ 
dne of the ■ documents to be used in the fieid test. For most* issues, , • 
there are several items,, spread over one or more of the documents. .Use 
of such multiple observations increases 'the reliability • and the validity 
of the ,data gathered^ By combining item -responses, the product devel- 
opers can pinpoint exactly what changes need to be made in the guides. 

^Documents to be used in ^collecting field test data are'described in f 
Appendix. B. The ^description of "each/ comprises its purpose, how it is 
used, the information it gathers, and who completes it. In ; some case^^ 
separate groups have separate, forms/ The, role of each document in ttie 
fi^ld test, and 'its relation to the stagesS^ criteria, of the field 
fce^t, are discussed in later sections. , Some^ai>cum4nts consist of two 



scales which gather related, but somewhat different,* information. For 
the sake of elarity, these scales are described separately in Appendix B. 
Draft copies of the documents are in Appendix' E. • / 

Drafts of these' documents/ as* well as copies of * this, field test plan, 
will be submitted to appropriate federal, state, and local officials for 
review. A submission has already been made to the Federal' Education Data 
Acquisition Council (FEEjAC) . State and 'local review will take- place 
during this federal reviews Local sites will be^able.to review the 
documents as part of the site recruitment and selection processes. Local 
and state administrators will be asked to comment on the field test plan 

.and documents with respect to such issues as the practicality of the plan, 
problems that might be encountered in working with teacher unions, the . - 
willingness of teachers to use the materials and to complete field test 

-documents, and the realities of working in various urban, rural, and 
suburban settings. 

- • . \» 

One major issue pertaining^ tbH^e^eatf»r~ami -a&a£&Ls£Ta£&t^Mou£S r ^^ 
is that of response burden, i.e., £he amqunt of time required of these .■ 
persons to respond to the documents. The estimate of the response burden 
given below includes only the time needed to complete field test docu- 
ments, and does not include the time which a teacher or administrator 
might use:in actually trying- out 'the Resource and Teacher Guides..' 'No ; 
time estimate has been included for. the technical reviewer or ;Field Test 
Coordinator groups since they are, directly or indirectly, employees of 
the^ project. 

Number Estimate of average 

Respondent Group (estimated) ... person-hours per document 



Teachers 
Administrators 



-240 5 0.5 * 1..5. 

30 0.5 - 1.5 



'jR'.The relationships between the data collection documents and scales : 
and 'the evaluation criteria' and^topics' are. illustrated in 'Appendix C. An 
"X" on this chart indicates, .that' at least' one item on the designated scale 



Will provide information to be used in answering that particular question 



Examinations of this chart will show the source of information for answer- 
ing each question and aide in insuring that all questfbns are covered and 
that not too many sources pf information are used for any-one question. • 



Field Test Activities Beginning with Site Selection 




As indicted previously, the Field Test Coordinators bear much of the 
burden of gathering an£ summarizing data. Their work is critical to , the 
success of the field test. They must assist in site selection, work 
closely with participating teachers and administrators, collecC data in 
a standardised and timely fashion, meet time schedules, and provide in- 
formation about £he implementation of the guides. 

The dat§. collection process, can be viewed as occurring in four stages: 
site selecpjLon, site preparation, materials usage and site tlose-out. 
Certain tasks are performed, information collected, and instruments com- 
pleted during each stage. The paragraphs below describe only the roles 
o£ teachers, administrators, and project staff. The activities of* tech- 
nical reviewers -^re discussed later in this section. - . 



Site Selection r - • 

The technical proposal for this project calls for field testing the 
guides in sites representing a geographical spread across the country. A 
"site" is a local district or school with a vocational , education program. 
Field test sites will ie in California, Florida, Georgia, Illinois, 
Minnesota, and New York. " New York sit^is, because? of their accessibility 
to project staff, tgLll a£so c be usedvfor pilot teat purposes. 



Directors of vocational education in the States named 'have been , 
contacted and have made initial nominations of potential sites'. These 
directors have nominated sites which, in their opinion, represent to the; 
greatest possible extent, ;a geographical- and population mix, which are 
committed to basic 'skills instruction', which coves the seven* vocational ^ 
education areas, wfuLch have a good relationship with the state department* 
which are accustomed to innovatiou, *and which will be willing to partici- 
pate in the activities associated wifrtf"the' field test. 

' ■• , O . • . ■ 

* Such site nominations constitute the preparatory stfep prior to the 

initiation of the final site selection. \lt should be noted that nomina- 

tion does not guarantee selection for the £ield test. Som§ states have 

• • nominated more sites thamcan be accommodated b^ the personnel and , 

resources of this field* test. In addition, some of the site nominations 

may not entirely satisfy the nomination criteria, lis ted in the previous 

... • - ? 

paragraph. Further, nomination by the state direct-prs does not guarantee 

- V that a given site is willing, for its part, to paifticipate In the project. 4^ 

Nomination is only an .indication that the site may wish to participate. 

h — ■ **** * * 

Sites which have already been nominated ,are listed in'Appendix J). 

> Using such nominations as an* introduction and referral? Field Test 
Coordinators or other project personnel will contact the <sites to begin 
,the site selection process, 'it will be the task of - the "Field Test CcSftr- y 
ditrators to conduct- tfte negotiations' with site personnel leading %p the 
." : site's decision to participate, ofenot^ participat^L in the/ field test:, 

* Because the states and sites will vary widely in their lofcal proce- ^ t 
b • dures for making such a .decision.,* it is not possible to- prescribe specific 

tasks or -a sequence of* tasks for: the negotiation process, tn generally \ . 
however, it is anticipated that the selection stage will* begin wlth^the 
Field Test ^Coordinator introducing the ..materials 'to the site persotinfel\ - ^ 

; and" 4xploriE£ with* thert the Match between the site\$ needs an<-Fthe 

-ktemal3%" The Field Test Coordinator can then discuss the resources y' ^ . f * 
^requink f or perfpmzng-fehe activities outlined in- 'the- -materials and work " , 
* vith^sl-^ ' ~V 



• ' * -* • . 

with those needed for -lising the maC^spfefer ' Coordinators wili also com- 
*' municate the requirement! for colled^tng^data; from site' participants 
during the field test. ~ 



Site .administrators 
field test tod commi 




tors must then decide^g^eth^•'tp participate in the- 
t time,, personnel, and r^G^ae^X /The. Bars ic Skilly. 



Project Director will decide whether the sXt^ 29- &. tte<: included' 4n the 
field tfest. The Project Director's decision vil^^k^ia^r^how well th£„, 
site fits the original criteria for nomination^Cmehti^ned previously), 
make a judgment as to *the site f j3 ability and wi£Mugne£^ to. commi£ time, 
personnel, and money to the field test, and othf&t factors such as the 
presence of special needs students at the site^and range^ of vocational 
^educational program areas at 'the site, and the^site's need for assistahce 
in ^teaching basic skills \ In making this decision ,' the project Director, 
will have ^information available that was collected on the^ite by .the 
Field Test Coordinator and other' project* staff - ^ % \ 

The selection stage may be considered to terminate when authorized 
site administrators decide to participate in th^ -field test , ; and thfe v Basic 
Skills Project Director, in consultation #itlv the sponsoring USOE project 

officer > decidera that the site is to be included. A final : deci^ion should. 

• ' * "\* " "Statu 

be concluded with a. letter of commitment spelling out tfce activities to *^ 

' <t * \ ^ ? 

be performed, and the resources to be provided. by the project arid the site.. 



It should be emphasized that evalua-fcion information is collected dur- 

ing the site selection stage. During- the dite selection stage the Field 

Test Coordinators and other project staff will -work w£th State and 

LEA officials to recruit and include sites inv-ttie^fielcl test.* During* this 

entry process,* the Field Test Coordinators and rikfr^r' 1 staff .should eff^c-- 

tively communicate the nature^of *the project and ,tne' guides," the*fcatch 

between *the kite's needs and resources, and the limits on jthe patufe and 
* * /- - * v " 

amount of - assistance available^ As ^ result of tjiis entiy process, there 

should be a mutual commitment ^between the # site and the yprbj[ect.st|Lff re- 
garding k theij: respective responsibilities in .the f felfl -test. / 
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During, this stage, the Fiield Test* Coordinator completes the Site 
Selection. Log for all sites, including" those which are nominated but" 
which, * for whatever reason, do not become participating sites. This log 
records the -site selection activities, the persons involved, and the 
product and'site factors which influence a site's participation, or non-« 
participation, in the field test; 



Site Preparation % * . • - 

. In this stage, the Field Test Coordinator and the site staff begin 

to work together to implement the usage of the materials fdt the field 

test. The site should Allocate the necessary resources for the field 

test activities which it already committed itself to in the previous 

* 

stage. The site may wish to appoint a teacher or administrator to act as 

coordinator of the* materials usage, activities. The Field Test' Coordinator 

^nould orient the local coorc^inatpr to the use of the guides as soon as 

possible, preferably before other site staff "attend the orientation 

session (to be discussed below). The Field Test Coordinator works with 

the 'local coordinator, or other site staff, to select tne teachers and 

administrators who will participate, 'to 1ielp schedule meetings and work 

sessions which may be needed to implement the/use of the guides, and 

possibly to plan and gather information the participants may. need in plari- 
• • • * * * 

ning"the use of ;the materials. # ~ 

• ■* ■ . * 

\ « 

The site preparation stage culminates in an orientation session for 

those teachers and administrators whb'have befen notified of their selec- 

tion for participation .in^the field test* The purpose of the orientation 

-*$f* _ - 
sessions, is to inform the participant of the purpose and use of the 

guides, and to begin their invplvem/etnt with their planning, use, and* eval^ 

, ua'tion* A possible* agenda for such an orientation session, subject to 

considerable variation, depending on site Condition's and the final config- x 

uration of the materials, is presented in. Figure -1. At such a session, \ 

the teachers and administrators can review and' criticize the guides, ask 

(piest.ions^ and, begin to plan,,for their use. They will also .be informed: 



1 * 

Figure 1 * 

OUTLINE OF ORIENTATION SESSION ACTIVITIES 



Welcome and introductions (5-10 minutes) 

Introduction to the Basic 'Skill Development Through Vocational 

Education Project and " the guides (10-15 minutes) 

a* Background and purpose: Need for the materials and how they 

were developed' ' 
b. Overview of the' materials: Their content-, organization and use 

Hands-on inspection pf the guides (10 minutes) 

Break (15 minutes) 1 

Detailed walk-through of the guide books (30 minutes) 

a. Illustration of 'possible ways of ,using,the guides 

b. Discussion of resources needed to use the guides 

c. Questions and further discussion with participants' 

Planning session (60 minutes) *- 

a. Use of materials by individual teachers and administrators to 
plan assessment^and instruction 

5. Use of materials by groups or teams of teachers and administra- 
tors to plan assessment and instruction / 

c. Technical assistance by Field Test^Coojj^nator and otfcer project 
staff 

Field test activities (45 minutes) x . 

a. Exp lariat ion- -of *ield .test purpose and activities 

b. Discussion of teacher .involvement in field test • * ' 

c. Completion, of . Orientation Document by teachers and administrators 
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' ' ' ■ 

of ..their further involvement through the data-gathering activities of the 
field test. The Field Test Coordinator will explain the purpose of- the 
field test, the types of data to be collected, data collection methods 
and documents, and how this data is to be used for materials improvement . 
The teachers and administrators will complete an Orientation Document con- 
sisting of two parts: 'A Participant Information Scale and a pre-usage 

form of an Attitude-Skills Scale- Detailed descriptions of the adminis- 
trator' and teacher versions of. the Orientation Document are in Appendix 
B. These documents are, fairly brief and an individual should need no 
more than 30 minutes to complete an entire document* No form completed . 
by teachers or administrators will ask for their na£es or other uniquely, 
"personal identification. As part of the information on- the field test, 
the Field Test Coordinator will also review with participants the. Guide- 
lines for Comments which ask users to write marginal notations in the 
Resource and Teacher Guides during their use of the materials. 



Materials Usage 

This stage ^curs| during die scheduled period for the field test, 
i..e., e between September 1 and December 15, 1980. Because of local varia- 
tions and the possibility of some sites making. a late decision* to parti- 
cipate, some"sites may nbt^conduct their orientation sessions and begin 
use of the guides bef oreJDctober 1. It is during this stage that teachers 
and administrators actually use. the guides. It is their period of great- 
est involvement in the field test. Because they are using field test* 
versions of the guides, teachers^and administrators may need some assis- 
tance in solving probl«^s, which arisfe in their use. While Field Test 
Coordinators and the,pr6ject staff should hold their independent inter- 
vention ±xt thfe sites to a minimum, they must be prepared. tQ^prpvide con- 

*: " - ■ , > • - ■ • 

'"SreTte assistance on immediate problems. Partly, thfs will be' achieved - 

" % „. ■ * • ■ ** 

by setting up a telephone "hot line 11 by which users can call for assis- ; 

tance. Assistance can take the form of" answering questibn^ .and solving 
problems over the phone, "over^tl^shqulder 11 assistance provided, in persoij 

• 19 . m 



reviewing completed tasks, providing .feedback .to the site personnel ' c 
regarding thfcir work, and other ass'is^fence appropriate for locdl needs * 
and conditions. . ' r> % - m 

* c - 

; - During materials usage, the Field Test Coordinator keeps a record * 

' * • * # * ^ 

of work with the sites and of ithe technical assistance which is provided 

* ' * , ■ ***** j 

them. The Field. Test Coordinator keeps records of activities and assis- 
tance* using tile Ffeld Test Activities Report, and the* Technical Assistance 

Contact* Report. The Field Test Coordinatot also gathers information* for 
> \* ■*■ * ' • . " 

.completing the Site and Class Description Package during this time based 
v ' . * ' \ • 

on information- gained frota teachers and from school records. Teachers 

~«and administrators wfeto^use £he materials c^n make comments in writing on 
the materials during^tHiS* stage following the inktruction^in the Guide- 
lines for Comments introduced earlier ^t. the orientation session. 

9 % ' , u 

• * * ' Va , "** • * * 

, . . o». **• * . • • 

Site Close-out . / * . * [' * 



During this stage, the field^t^st activities and project 'staff H in- 
volvement at the local sipe will be brought to aldose. The. site may, of 
cqurse, continue to u$e the\materials on its own. ""Tfie major event of the 
site clqse-oufc stage will be a meeting of all the tfeach^r and 1 adminis- . 
trator participants at «which time they ^will be. asked to recount their s ' 
experiences with the materials, and make criticisms and suggestion'? for 
rey^sibn^. At this final meeting, teachers ^d administrators will £om— " 
plete .it germination DocuiMfct cpnsisti«*g of* two' parts: a Product Eval'- ' 
uation Scale and a post-usage form of. an Attitude-Skills Scale.. Detailed 
descriptions of the administrator and teacher versions of the "Termination 
Document are in Appendix B. Completing this document Wlll'xequire approxi 
mately 30. mid^tes of an individual's time. . . V ' ■ _ 



Field Test .Coordinators will also conduct interviews with the parti- 
cipants using the Interview Guide, a list*"o£ open-ended questions which 
•will be asked verbally of the participants and which they will answer 
verbally. Notes will~.be , kept of their answers. With their permission, 
the interviews will also be fiape-recorded, and their answers transcribed 
later. The interviews will be fairly brief, probably no more than 15 to* 
20 minutes. At this' clo.se?*>ut meeting, the Field Test Coordinator will 
collect the users' copies of the guides with their comments written on 
thea, land replace these with 4 clean copies, for participants to use in the 
future* \ 



In summary, Field Test Coordinators will be responsible, for -data 
quality control, collection and summary analysis of data, and reporting 
of results. Field Test Coordinators will transmit data and summaries o* 
data on a regular basis so that materials developers may begin improving 
portions of the guides before the end of the field test. 

*' f 

. ~~^^roject stfiff will be responsible .for having the materials reviewed 

' * • a 

by the technical reviewers. It is. anticipated thatgth^se reviewers* can 
• ■ •* * * - ' • 

begin reviewing the field^test versions of tjie guides as soon as these 

are available. Reviewers will write comments in the materials as instruc- 
ted by their own,form of sfhe Guidelines for Comments, cdmplete their " form 
of the Product : Evaluation Scale, and be interviewed by project, staff ^. 
regarding their reactions to die/ materials using the .reviewer form of *. 
the interview* Guide; • f 



.1 



Summary of Field Test Groups, 'Stages, and Documents 



At: this point, the reader may find it helpful to consider the inter- ^ 
relationship of the groupis, stages, and documents which have, -been discussed 
in preyirqus sections, thete are; four stages to the field test: site 



selection, site preparation, materials usage, and site close-out. There 
are four groups participating in the field tfcst: teachers, administrators, 
technical reviewers*, and^Field Test Coordinators. Each group has certain 
da.ta collection 'documents which .it completes in one or more of the stages 
of the field test. A summary of which groups; complete which ^documents in 
each stage" is presented in Figure 2. As a supplement to this figure, the 
reader may wish to refer to Appendix B which gives a brief description of 
the documents to be used in the field test. . These descriptions are arranged 
and labeled according to the letter and number combinations (e.g., la, 4c, 
etc./ given in Figure 2. 

The relationship between the documents and the evaluation criteria* 

topics* and questions is illustrated in Appendix C. The symbol "X" in 

- — * v ^ 

the Appendix C chart signifies that at least one item oh the indicated 
document or scale will contribute information to*be used by the developers* 
in -answering the indicated evaluation question.. It does not mean that cjje 
evaluation question <d.ll be on the document, only that there will be one 
iuem the "document" which, when its responses are analyzed, will confccibut 
awards answering that 'evaluation question. 

X • 

*** € Data Analysis ■ 

. « * I 

♦ 1 * V 

Formative materials evaluation % requires the reporting of findings that 
can be easily used and reported in a timely fashion to the materials devel- 
opers;T^ However, no great- Sophistication is necessary in design and datav? 
analysis. For many items on the forms, simple tabulation of the frequency 
and. percentages of persons/respondents selecting the responses will Suffice,.* 
Means an& standard dSviations will be computed for items with scaled re- 
sponses (e*g.,' a iour-point scale, whereas trongly agree* 3 * 4, agree « 3, % 
disagree .* 2, arfdi strongly disagree * 1) .^^ill-in or "completion type items 
will be examined, ^compiled, and summarized to present major categories of 
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Figure 2 '. 

SUMMARY OF FIELD TEST" GROUPS , STAGES , AND DOCUMENTS 



Groups 
and' 

Documents 



Field esse stages 



.Sita Site Materials Sic* 

selection preparation usage closa-out 



1« Teachers 

s« Orientation Document - 
Teacher version 

b. G^idalina^for Comments - 
Teacher version 

c. Termination Document - 
Teacher version . 

d. Teacher interview . 

2. Administrators 

a. Orientation Document - 
Administrator version 

b. Guidelines for Comments - 
Administrator version, 

c. Termination Documanc - 
Adminiscracor version ; 

c. Administrator interview 

3» Reviewers 

a. Guida Unas for Comments - 
Reviewer vtrsioa 

b. Produce Evaluation Seals 
Reviewer version . 

c. Reviewer interview 

4. Fiald Tasc Coordinators 0 



X 
X 



X 

X 



X 
X 



a* 

b. 



d; 



Slca Selection Log 
Sica and Class Descrip- 
tion Paclcaga 
Fiald last Activities 
Report* Format ' 
Tec h nical Assistance 
Contact Report . 



X 
X 



Footnotas 



ment 



symbol "X" indicates that, this group will complete this docu- 

during' this, stage of the Afield test. • "** 

• * • */ . * 

> ' b - > ■ V£ . 1 < ' 

' The interviews: of teachers*, administrators, and .reviewers are actually < 

ct»ducjid jby^tfce' FieMrTest^ doordtiiators. "Members of these 'groups give t 

only verbal ansyers^to^uestions; and t has a are/writtan- down bv the Field. ' 

Test Cpori^torV^HcvewV since., teachers, administra?6r»v and reviewers 

are the scurce^' of/ the- responses and- sines their time is^ required in border 

to raspond* the interviews . ara 'listed under the* respective' groups, rather. 

cfian^3^ , * l • \ / . » 

• c'- " '< * 1 " ^ _ ^ *■ *v ! 

These documents ;oay also,,be- completed^ by mambers of "the project L.*., 
( istaff> o^^*than ^W^^JOil^lM^Sim^ ^fi%id Test Activities Reports' 
ara cc^letad .-p^clpaily during the Materials Usage, staged but may also . p 
Be cc^ la tad; 4 \ «•< 



participant comments. Data will be ^tabulated for sites and .for respondent 
groups , as a whole • Data will also Be cross- tabulated by variabiles such 
as position, experience, region of country, area of vocational specializa- 
tion, etc. ' \ +•* - . . 

The only statistical tests to be conducted will involve those items 

which ask teachers and administrators to rate their owj-j/skills in teaching 

basic skills and their attitudes regarding the practicality and d$sjteab£l- 

ity of combining basic skills instruction with vocational education*. ,It 

is hypothesized that, after using the materials, educators will perceive 

the ms elves as being more skilled* in teaching basic skills and will per- 

ceive efforts to combine basic skills with vocational education as more 

practical and desirable. An analysis of variance, -5r other appropriate 

- . ' * \ 

statistical techniques, will be used to test this hypothesis. 



Timetable? 

Collection of data, related \to the field test will start with the 
Site selection, process in *£he spring .and summer of 1980. Reviewers' may 
review copies of the materials as. soon as drafts of them are available. 
Participating teachers will actually use the materials during the field 
test 'periods from September 1 to December 15,* 1980. Data collected during 
site selection and the ^early pf rffe? ~t$e' field test will be tabulated % 
arid analyzed while 'the rest of' the field test is going on. Thus, initial^ 

Ijiits, in draft form', will be available to project staff and advisors 
by middle or late October, -1980* The complete body of data will be ana- 
lyzgd following the ,efid of the field test at the sites on December 15^ . • 
,1980. Results will be available to product* developers in the form of 
draft copies' of the tables in mid-, or late January, 1981. \A S f ^nal report 

on the field* test will be available aon February 1, 198}. ioY .distribution 

• v '* \ ~~ r *** • *• ' * . - . . ' ? , t 

to project staff, the project, monitor and funding agency, and other , - 

interested ^persons;. A more widespread distribution of result s^jd.11 be 

macje . at a later /date as /a v par.t of a larger report jof thjte total materials 

development process. ' , ' ^ 9 *• + - * * 
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. Appendix A ■ ' . • % - 

MATERIALS EVALUATION CRITERIA, TOPICS AND QUESTIONS. 



Criterion: Usability 



1.0 Clarity 



1*1 Art tha materials' objectives clear and comprehensible to users? * * 

1.2 Is eh* text of the materials clear and comprehensible co users? 

* 1.3 Dot* the'seouence of topics in the aaterials contribute to tba clarity 
of ths concent? . m + 

1.4 Do •tba* Illustration* contribute to the clarity of tha content? 

2.0 Flexibility or adaptability 

2.1 Do ,tH*~ processes and outcomes of uainfc tha materials suggest chat they 
are^iseble * 

i 

a. in differing Institutional conditions, e.g., hone-school, vocational' 
* canter, ace? r> 



b. different grade levels? 



c. in tha saves vocational areas?' 

d. by teachers with differing training and experience? 




X Can user* plan and .conduct diagnostic caet procedures outlined in the 
materials? ' 

3.2 Can users plan and conduct p rescript iv* Instruction In bas^c skills as 
outlined in tha materials? 

3.3 Can users relate diagnostic test procedures and results to. prescriptive 
instruction as outlined In the aaterials? » 

3.4 Can users plan and conduct assessment .procedures as outlined in the aaterials? 

• 3.5 Can users related assessment procedures and 'results to prescriptive ins true* 
tion and-vocsctonslr^esds-as~ouriined^in~ the^WteriaTs? 

3.6 Do tha materials give sufficient guidance for planning testing and prescrip- 
tive procedures which are consistent with school procedures? 

3.7 Do tba materials give adequate guidance in other tasks related to the imple- 
mentation of diagnosis of student needs, prescription of instruction, and 
assessment of results? * 

4.0 Level of resources 

4.1 What level and kinds, of resources do users expend in* using the materials with 
•; respect to , • 

.a. 'person*hours? 

b* dollar .expenditures? * 

cv * nondollar resources? , 4 

5,0 Acceptability * * 

S:i .What was the. nature and extent of the opposition, if any/ to tha use of the 
.materials? "*"..« 

5.2 Did users view the materials as being practical.,^© use? 1 : 



6.0 integration ' - * • *f ' * v - * 

6.1 Can /the teeta; and procedures outlined in the^ aaterials be intsgrated with 
* other school curriculum and' testing- programs"? * »« 
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( ^ Cricsrlon't Effectiveness 

> • . * 1 

1 . 0 Content v * 

.1.1 ts # che content of che macirials appropriate for che needs of ceachers? . 

1.2 Is che content currtnc with present fcnovledge and developments regard- 
, lag the provision of basic skills training and vocational education? 

1.3 JCs che coaceac of ,eha 'materials accurate? 

1*4 Does che coat sat of the materials include all relevant ia format ion, 
adequately covered? 

1.5 Does the coat sat of che sate rials exclude irrelevant la format ion? 

2.0 User pre requisites /characteristics 

2.1 What la-service traiaiag is required for effective use of the 'materials? i 

2.2 What previous educacion is associated vith effective use of che materials? 

2.3 What previous experience is associated vith. effective use of the materials? 

3.0 Teacher perceptions -* 

3*1 How do* the materials affect users' instructional practices? 

3.2 How do the materials affect users' attitudes cowards che importance or pro- 
viding basic skills instruction in their voce clonal programs? 

3.3 How do the materials sffect users' perceptions of their skills at providing 
basic skills instruction in a vocational program? ^ 

' x . 

4.0 Pupil characteristics 

4.1 Sow Is effective use of the materials influenced by such pupil characteris- 
tics as * 

a. race? * #■ 

b* socioeconomic status?' 

c. achievement level? * ' 

d. ocher factors? ^ r " 

• s * 

3.0 Potential Impact „ 
, 5.1 What do users perceive aa the potential Impact which che materials mighc have 
on instruction i x 

6.1 To what extent do users view the materials as being valuable? 

6.2 Are the materials directly related to significant needs and demands of school 
personnel? ° 

■ - * 

7,0 Attractiveness 

7.1 Are the materials attractive to»users wich respect co appearance* layout*. - 
.illustrations, format, typography, etc.? , 

i /- • *' • 

8,0 Social equity 

8»1* To whaT extent' co the materials exclude or counter bias and. discr imin ation 

s.-, . related to *, * J y ^ * * 



• a* sex?» 



"i 



b, , race or ethnic/origin?- ^ 

c. socioeconomic status? 



9 . 0 Unintended ef feces * 

fc C 9«i positive-- or negative ^effects, which, were ^not directly intended, are 

v - observed; as a'; result of materials' use? 

r ' j t • \/ - • >;*' • 

10:0 Variability of effectiveness ' k . 



10.1* ToVwAst' extent .tofresults on the above "effectiveness Issues vary with 

ksT> : -. • .r ' ' respsce v tb V -** ' 



;<- v ;'^ . \ !^ a., region? 

^ ^> ^/Lj b.. " vocational ;area? ^ Vw. ' - \ ' * 

|S O ^ ,'jaV; * * d. other' factors? * ~~ 



* ' d. othsryf actors?: - - QO 



" -*iS 



*\ Crittrlon ; Canarallzab Uitv 

1,0 Intirnt . 

1«V to what axtant do usiag'sitaa, and pottntial Jieas, display an inttraat 
in usirfg cha aatariais? ** 

2«0 Raasonablanass of coats ' 

2.1 Do ustrs-parcalv^cha oosts', of purchasing and implaaanting cha matarials 
as. baing raaaonabla? t . 3 • « 

*: *" 

•» . \ * • 

3-0 Taachar'dlffarancas ' * \* ^ 

3.1 Art aatariila aqually'usabla b$*diffarant taacnars? 

* 3.2 What diffarancaa ara Cbara batvaan eaachars in thair usa of tha mattrials? 

4.0 Sitt dlffarancaa 

4.1 Ara tha aatariaia squally usabla" acroaa sitaa? 

4.2 What diffarancaa ara thara batvaan sitas in using tht oat trials? 

3.0 District diffarancaa ^ r 

5.1 What af facts do district organizational diffarancas hava on aatarlals usaga 
and isplaaantation? g 

* » * • • 

5.2 Ara tha nataria^s squally usabla by districts with diffarant organizational 
/ arrangaaants for providing vocational tducacion and baaic skills? * 

% * 

6.0 Stata dlffarancas 

6.1 What af facta do scats policiaa and prioritfaa hava on aatarials usaga and 
iaplaMtttation? • 

\ . .. — 

7.0, Soacial tducation 

7.1 Do tha aatarials giva uaars adaquata guidaaca'for planning and conducting ' 
basic skills instruction* for 

a. handicappad stud ants? 

* ' » ♦ 

* * ' b. disadvantagad studants? / ; 

othar stud ants with spacial naads? 



8^0 Ds< 



Usa With idults , ' f , , 

8.1 Do uaars faal that tha, aatariala could. potentially bt. us ad to incorporata 
basic^a4cilis Instruction in adult adu'catiod claaaaa? 




. 'This appendix Urstf fai^ t^ 5^ 
tion 4ata during ^hejfi^ documents 
to be eo^leted^^^^ arid^fevi ewers, These;-ar% . 

.considered together because _bf the%ii1d3:arfty of the dpctju^ntV '^oag these, 
groups; Part 2 deals' with^^ cc^JLete'd by the 

Field.Tes.t Coordinator.^ : ^'^>? - : : - : -\ • jjr . - 



Each- document has. a number and, letten code preceding it. This codes 
corresponds to the labeling used in*Figure 2 iii the text of this field 
test plan. Figure 2 displays the relationship among the groups, stages,' 
and documents associated wfth the field test. For convenience and logic 
in describing the documents, they have been arranged somewhat differently 
in this appendix. However, the labeling system from Figure 2 has been 
retained. Under this labeling system, documents are labeled acceding 

t6 theses ponding group, as follows:'- . f ^ ' *• 

-» 

^Documents * labeled ' 



la .through Id 
2af through 2d, 
3 a through^ 3c 
4a through 4d« 



Responding group - 

Teachers 

Administrators 

^Reviewers % " 

Field T£st* Coordinators 
(or other project, staff) 



Pari** 1 «* Documents completed by teachers, administrators^ and reviewers 

la. .Orientation Docufoent> - Teacher Version . » * „ ♦ , ■ 

2ay*?' Orientation; D^ument - Administrator ^tersion * . " k ; 4 . 

The Orientation* document for both groups, consists o^f two scales* The 
Partici#^t Information .Scale gathers information on the characteristics 
of teachers arid adfldnis.trator< who participate in the field tfest. It 
focuses primarily on" general demographic information about. the resppndent, 

* * : ? ^ A ' . bin: ■ • / ' : • 




title'and duties', education, work experience, ^nd educational arid pro- 
fessional activities • "The Attitude-Skills Scale gathers information about 
materials users' attitudes towards various aspects of the provision* of 
baisic skills instruction in a vocational education context, and also about 
users' self-perceptions of their own abilities to perform takks associated 
with the provision of basic skills instruction as outlined In the materials. 
Attitude items, assess the respondents T feelings regarding issues in- the 
delivery of instruction- in a vocational education* program, the respon- 
dent f s desire- to learn ways to* improve basic skills instruction, his/her 
personal commitment to change and improvement, and so on. Task items . 
assess the respondents perception of his/her own training, experience, 
and ability to perform the instructional improvement t^sks outlined in 
the materials. A portion of the Attitude-Skills Scale .will be admini#* 
tered on a pre-post basis; sa that the degree of change* in attitudes^ and 
skills of users over the field test period cquld be estimated The 
teacher and administrator versions of the document are ,nearly\tdentic'al, 
and differ only in that some of the items on the two vetsions ate worded 
slightly differently. The Orientation Document is completed 4tjring the 
Orientation Session. It; will require no mora^than 30 minutes to complete. 



lb. Guidelines, for > Comment^ - Teacher, Version 
2b. 
3a. 



Guidelines for Gomments - Administrator Version 

; r— 

Guidelines for Comments Reviewer Version 



This is not a document in itself but is rather intended to provide v f 

' -* * ' * 

guidelines to persons/heading the materials. *'lfe aletts rJaHers to specific 

'points to look f oy Ln- reviewing the materials and instructs* tlh^m as Vo 

what comments tc/ write on the materials themselves.* tn a effect, ) this' 

tonvertsr the 

o'f users and /reviewers. It is anticipated th'at the instructions for .each* #9 
of the grouofe indicated will be slightly different, depending on what ^ 
issues we w£sh each group to focus. ' • ,* , . \ * • 
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1c. Termination Docihnent - Teacher? Version 
2c. Termination Document - Administrator Version 

3b. Product Evaluation Scale Reviewer Version 

* • • i 

For teachers and administrators j^^the Termination .Document consists 
of two scales, a post-usage form of the Attitude-Skills 'Scale which was - - 

* % - * 

also completed as part of the Orientation Document, and a Product Evalua- 
tion Scale. Reviewers receive only the Product Evaluation Scale. The 
purpose of this document is to gather reactions to the materials in an 
objectives organized way. Respondents will rate portions or features of 
£he materials on rating scales. Fill-in and open-ended type items will 
ask them for specific suggestions for changing the materials/ Possible 
topics include the materials 1 clarity, usefulness, problems in use, content, 
the perceived value of the materials, intent to use the materials again, 
etc. The Product Evaluation Soale for the three groups will focus on 
somewhat different issues, or will have items which are worded somewhat 
differently.- Completion time for the Termination Document should, average 
about 30- minutes. 



Id. Teacher Interview 

2d. Administrator Interview - 

3c. Reviewer Interview- S * 

The purpose of these interviews is to "gather reactions to £he^mater- • 
ials 2nd their usage and outcomes. They are* designed to supplement infor- 
mation gathered* with the Product Evaluation Scales. The interviews will/ 
include questions which require a more open-ended, extended response or 
which may warrant a deeper exploration or probing than can^be accomplished 
with short written answers. Interviews will be conducted. by' the Field 
Test Coordinators or other project; staff, and with permission 'of. the 
respondent, will also be t#pe recorded with small portable .recorders for 
later reference* The' interviews will require /only verbal responses, and 
no- written responses, from teachers , administrators, and reviewers. The 
set of interview questions wilL be somewhat different * for each group 
indicated. Interviews should require no more than 15-20 minutes of teadher 
and administrator time." ' % ^ 
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Part 2 - Documents completed by Field Test Coordinators 

4a. Site Selection Log - * ~ 

The purpose of the log is tQ provide £ systematic format for gather- 
ing Information about participating sites during the process of gaining 
their participation and cooperation in the field test. It may also 
provide information on sites which explore the possible use of the mater- 
ials but which decide not to participate in the project. It consists of " 
two, parts. It opens with a brief narrative account of the districts 
decision to participate, or not. The second paA lists product character- . 
istics accompanied by rating scales which describe the extent to which 
each characteristic influenced the district's decision to participate. 
^District characteristics are also listed and rated with respect to their 
influence on the decision to include the site. This document is completed . 
by**the Field Test Coordinators during the site selection ^process. ' v ' . 

4b. Site and Class Description Package m j * 

This document consists of two parts: a Site Description Scalp and a 
Classroom Description Scale. The Site. Description Sca^e gathers descrip- 
tive information ofi the sites which participate in the field, test. This, 
information includes number of students, population density, -percentage 
of urbanization, percentage of nonwhite population, and other factual 
information about each site. * Usually, the Field /Test Coordinator^will be 

*** able to obtain such information from local administrators or reference \- 

booka. The second part, the Classroom Description. Scale, records information 
regarding the individual classes~which ^receive instruction as a result of: 
their tea'chers* uae of the , materials . This can include ,th6 racial or 
socio-economic composition of the class, the average and range of achieve- 
ment test scores in. basic skills areas, the -nature of . the .program which- 
. the class is in, and- so on. It will/nbt gather information about individual 
students. When the Field Test Coordinator has completed^a Site and Class-- 
room Description Package'for a site, it consists of one" copy "of the Site *J ^ 
Desc^ptlon Scale plus one copjpof the Classroom Description^ Scale for, each 

\ < participating class. • * 
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4c« Field Test Activities Report Format 

This is a format for writing a memorandum report of activities ' " 
associated with the field test. .It is to he used by the Field Test Coor- 
dinators to record any training activities or fongpl meetings with state 
^department personnel or local district teachers and administrators* The « 
format includes heading for context information (time, date, place of 

meeting or work effort, persons present, etc?.) the purpose of the meeting, 

.... . v 

a fadtual description of the % activities, outcomes^ accomplished, intended 

• , ^*-*> . 

future activities, problems encountered, implications for materials changes, 

and so on. 'The memo is to, be written by the Field Test Coordinator based 

on his/her notes. The Field Test 'Coordinator .will r^tain a copy and send 

the original to CIOE. t ' * 



4d. Technical Assistance Contact ^Report * , • ' < 

: — j 1 \ z % s * m 

This document gathers information about specific problems. encountered 

b# users „while they are using the materials. The form provides space for 

the nad^of >,the user, the person giving assistance, the means of assistance 

♦ ■ • 

(telephone or face^to-^ace) , the nature of the problem* or assistance, 

requested, what assistance was given, implications for the ^vision of 

materials, and other relevant information*^ The report ^is completed by 

Field Test Coordinators or. by project staff. 9 , . 
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Appendix C 
DOCUMENTS-QUESTIONS MATRIX 



This Appendix illustrates the correspondence between the instruments listed 
In Appendix B and cbe field Cue evaluation criteria, copies, and questions 
listed in Appendix A* There are three pages, one for tech of 9 the, three general 
criteria of inability-, effectiveness, and generalixsbilityt^Oocuaents art llated 
across the top of each' page, with the nuaber and letter labels used In Figure 2 ' 
In the text/ For* the reader's convenience, these labels are repeated Ijelow* 



< 



2* 



1. Documents completed by teachers 

la* Orientation Document - Teacher Version 

^^lb*^ i&ttldellneS' for fcomaents - Teacher Version 
1c. .TerainaclOTU Document - Teacher Version 
id. Teacher Interview i 

Documents completed by adninlscrators 4 
2a, Orientation Docuaent - Adalnlstratqr Version 
2b • Guidelines for Comments - Administrator Version 
2c* » -Termination Docuaent - Administrator. Version'* 
2d* Adstlnistrator^Xnterview 

Docuaents completed by technical reviewers t 
3a* Guidelines tor Comments - Reviewer, Version m 
3b. Product ^valuation Is cal« —Reviewer Version ! 
3c* lert ewer Interview 



3* 



4. 



Documents coapleMd^^^ley Test Coordinators 
or other prbjecc^taff " 

4a. Site Selection Cog * * ' 

4b*^Sice and! Classrooav Description Package 

4c. .'3FieXd Test Activities ReportoFormet * * 

4d* Technical Aselstance Contact Report 



Evaluation topics and questions are listed down the left side of each^page, using" \ * 

\ 



the nuaber designations given each In Appendix A. Figure 2 in the text shows ;tha 
relatlonahip among groups* stages, and* Instruments* The> reader ^may wish to refer 

co lt^ for further Information.'^ t il 
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Appendix fi 
NOMINATIONS FOR FIELD TEST SITES 




This appendix presents nominations for field test sites. Being ^ ' 
nominated does not indicate that those rfites have definitely agreed to 
participate, ripr does "it indicate that the project director has definitely 
decided, to' include them in' the field test. Such agreements will be made* 
only. af tier negotiatiott^ith state and" local educational officials. 

California 

Argus Continuation High School 
Ceres Unified School District ' 
Ceres, California 95307 \ 

Del Paso High School* 
Walnut Valley School District 
Walnut, California 91789 * . ' 

Central City Occupational Center 
Los Ahgeles Unified School District ? 
Los Angeles, California 90£)51 

Mountain View Continuation High' School 
Santa Ana Unified 'School District : 
Santa AnaJ California 92701 

Ncyrthern Santa Clara County Regional Occupational Program 
Sunnyv4le, ^California 94086 ' ' 



Florida I 

*' > St£ *£e££rsburg Vocatipnalf Technical Institute . 

^fcrwrwaeer, Florida '33518 m '\ \ ' * * • * ^ ~ 

•».* ■ • * » 

. DeLarid Comprehensive Sailor High School . , 

/ DeLand;' Florida 3&720' 3 

? * • ' ■ * * * * 

\ Washington Holmes Area Ypcational-Techxiical Center 

v Chip ley, Florida 32428: v / • / 
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• 1 > ' 

j i 
Georgia 

-'Wayne County Comprehensive High School ,v 
\Jesup,*Jgeorgia 31545 1 ' 

^ South DeKalb Occupational Education Center 
* Decatur, Georgia 30034 

Valdosta Comprehensive High School 
- Valdosta, Georgia^31601 



Illinois 

, Canton Union District #66" 
Canton, Illinois 61520 

- * 

Ea&t Richland Community Unit District #1 
^OXney, Illinois 62450 

Lockport Township High School District #5 
Lockport, Illinois 60441 ■ 

' Orion Community Unit District #1 
. Orion, Illinois 61273 



Minnesota 

Whitebear_Lake % Area Vocational-Technical Institute 
St. fcaul, Minnesota 

Hennepin County Vocational-Technical Institute 
Minneapolis, Minnesota . . ^ 



New York" >' 

-Broome-Delaware^Tioga BOCES - . " * ; 

Upper Glenwood Road - • * 

Binghamt on, .New Yoyk 13905 % \ ' 

Edison Technical and Occupational Education Center 
Rochester,- New York 14601 



\ . 

r 



Oswego BOCES ' ^ 
Mexico,. New York 13114 
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Suffolk. #2 BOCES 
Islip Career Center 
# Oakdale, New York 11769 

* George Westinghouse Vocational High School 

* t Brooklyn, Hew York 11201' 
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Appendix E 

' • . DATA COLLECTION DOCUMENT DRAFTS * 

** This appendix presents* draft versions of the^data collection docu- 
\: - ments which .arve proposed for*use during the field test, "The documents 

are presented in the order in which they wjwre listed on the opening pa$e 
of Appendix C« Documents completed by* teachers are presented first, 
followed by documents** completed by administrators, technical reviewers, 
and Field Test Coordinators. 

.It should be remembered* that these documents are „in draft form and 
are subject to revision before use, in the field .test. 



.FIELD TEST' 



BASIC SKILLS THROUGH VOCATIONAL EDUCATION 



ORIENTATION DOCUMENT 
Of Teacher 'Version 



Lei 



The Orientation Document consists of two parts. 



Part 1 - Participant Information Scale concerns your work experience; 
educational and professional activities, and 0 general background, 

« ' . * . ' * 

# Part 2 - Attitude-Skills Scale asks for information about yoiir' skills 
aad attitudes stfitih respect to teaching basic skills to vocational education' 
students, 



Check or circle yout response, or writ.e in a brief answer, according 
to the' instructions give* for each question^ ** 



~ Please remember that your replies are. confidential. 



PART 1 - PARTICIPANT INFOBMAItON SCALE * ' ' \ . 

Fojc& Questions -1 to 4, write the number # of years indicated, £ ^ 

1. How many years have you been employed by this school, district?^ 

2. How many years were you employed in other* districts?*, f • - x 

3. In how many other districts have your worked? . • . . - 

4. Ia how many other schools* have you worked*, in this district ° 

/ ~ or in other districts?. ^ 

^. Have you ever held, or do you now hold, any of , the following posijyis 
If you have, how many years did you hold Jihat position? ,* - . 

Circl/ your answer to show if you ever held that position. Write in 
the ^umber of years you held it to the right. 

Have- you Number of 

field this .years in 
Position " - I ! , position? position 

Yes ' No-. ~rj 




.a. Teacher.'. .y ; • \. \ . . . '.: Y - N 

b. . Department Chairman . . . . * . . / . . t N 

c. As sis tiuto '-Principal' . \ . a v .. vJ'* Y ' N 
d>- Principal . . . wvwi • , . . . . . ^. . . • i N 
e. Central District Of f ice" Administrator^ : " Y * N 

Other school district position.* . ? ' .* Y o . N 



If you answered YES to T e\ or f f T , give 
the position title (s) here: 



, r 

/ i 



^50 



- . I 
ODT/page^l 



Check, circle, or write in your answers as indicated for each question 
u in this sectioh. 

6. What is the highest degree you have actually received? Check one. r *■ 

*_a. Bachelor T s degree ' 

b. Associate degree in a .technical subject 

c. Master's degree * 
d. Ph.D. degree 



e. Other - specify 



7. In what year did you receive this degree? 

8. What^ was the major subject area of this degree?*^ 



9. Are you currently working towards a higher^ggree .than the one you 
now have? Check one. If yes, write in the subject area of your 
studies \ 

a. No - . 

b. Yes. What is the subject area ft your degree will be in? 



10. Do you currently possess any licenses , either as a teacher, an 
administrator, or other professional position, or as a cra£t3man? 
Writhe in the* name of these licenses below. 

• __ • :/ 

11. " List the names of the professional organizations of which you are 

currently a member. 



12. List, the names of no more thai three professional educafctjm^l journals 
'" which you read on a regular basis. 




ODT/page 2 



Have you ever had any training or experience working with- the kinds 
of students listed below in occupational or vocational education? 
If you have, circle 1 or E dr both, as appropriate.;, 



Training can include any^forjpal instruction such as college courses, 

in-service Workshops, or otner instruction. Experience includes * 
work with students as either a teacher or an administrator. 

Student groups * Training ' Experience 

a ? Gifted' students T E 

b. Students with learning disabilities. ... T E 

c. Slow learners T E 

d t . Physically handicapped students ' T • „ E 

e. Disadvantaged students . . t . . : . . . • T E 

f. Students with low reading ability. . . . . T E 

g. Students with low mathemathics ability . . T E 

h. . Students/with low. ability in language 
• % areas such as writing, speaking or 

listening, , . : . . . , T E 



i. Students* with other kinds of learning 

difficulties T E 



Have you ever worked with teachers of academic basic' skills (such as 
English and mathematics) to improve the reading" or mathematic skills 
of your vocational students? Check one. ; 

a* No. 



b. Ye§.* % Describe briefly 



Have you ever worked with other vocational teachers to help improve 
your students 1 'skills in reading and mathematics? Check one. % 



a. No, 



b. Tfes-. Describe briefly. 



ODT/page 3 5£ 



PART 2 - AITITUDE-SKILLS SCALE 

1. In which of the .following general areas of vocational education do 
you teach? Checlrone. ' v ' 

a > Agriculture and agri-business 

b. Business and office education 

c. Distributive education 

d. "Health education - 

# e. Occupational home economics 

f . Technical education 

g • Trades and industry 

h. Other - specify *_ 

2„ What , specific programs in vocational education do you beach? Write the 
course names on the lines below. 

a. 

b. ' \ . 

c. ' ; . 



3, What specific kinds of- jobs could a student get who had taken these 
programs? Write one or more examples of job titles on the lines 
below, . 



b._ 
c. 




In general, **at minjjgum level of basic skills would one>of youifyglfad- 
uates need for success in an entry-level position in the kind of jobs 
such .as- those you listed in Question 3? Circle one response for each 
of the five basic skills listed >elow, " ' * 

' - . " Minimum level needed 



Academic basic skills 



a* 
b. 
c. 

d.. 

eV 



Reading 



Mathematics . < . 

Writing ^English 
composition , % 

Listening - 

'Speaking. • 



Very high 
'level 

5 

5. 



5 
5 



4 
4 



.4 
4 



Average 
level 

3 

.3 



3 
3 



2 
2 

2 

2 



Very' 
low 

1 

.1 , ■ 



1 
1 



Hew much training and experience have you had in Reaching basic skills, 
§jich as reading, mathematics, and so on? Listed below are several tasks 
a teacher might have* to do to include basic skills teaching in a voca- 
tional , educational* program. , v • .. b 

Circle two responses for each task, one for your training and^one fqv 
your n experience. * , * * * , 

Training in these tasks can include college courses, in-service work- 
shops, or other formal training you have had. 

Experience means what' you have done to try to apply these tasks in 
teaching your students. •. - ^T' %:/ 



Training 



b. 



e. 



h. 



i. 



1 



Tasks 

Deciding what level of basic 
skills students need in order 
to learn in my classes 

Deciding what level of basic 
skills students need to 
succeed in a entry-level job 
in my area* 

Finding and us'ing ready-made 
standardized, tests of , 
students* basic skills 

Making arid using my own tests 
of students' basic skills 

Interpreting the results of , * 
ready-made standardized tests 
to assess student needs in 
basic skills 



Interpreting the results of 
k my own tests ,tp .assess students' 
needs in basic skills 3 

Finding ami* using materials arid 
methods to help vocational 
students improve, their basic 
skills* *r- 3 

Planning prescriptive teaching 
that .will- help sjtu&ents learn 
the basic skills they will need v 
^on-th&rjob • r • ** '3 

Determining how Readable the */ 
^textbook and other class 
^materials are in 1 the program 

I teach*' . , 3 



A lot Some 



c Not 
much 



*2 



Experience* 



A lot Some 



Not 
much 



3 
3 



) 
3 



v 



■2 



•1 



Training 



Not* 



Experience 



Not 



Ta£ks 

j / Findings out what levels of 
basic'* 'skills are needed* for 
^ jobs in the area I teach 

k. ' Teaching basic skills as an 

. integral^part of ,the voca- 
'"V tional education program I 
teach 

1. Motivating student interest 
in learning basic skills 
through vocational education 



A* lot c Some much A lot Some much 



2 1 3 

> 

2 1 ,3 

0 

2 13 



How well do you feel you can teach basic skills in your vocational 
education program? How well would you like to be able to teach them? 

Thq^list of tasks from Question 5 is repeated below. Circle two 
responses for each task, one, : to show how well you feel you can do the* 
task* and one to show how well you would l^!ke to do the task. 



Can do 



^ERIC 



Tasks 



To Not 
Very some at 
a ~> ; well degree all 



a. Deciding what level of ' basic 
skills students need ixi 

• order to learn in my class 3 

b. Deciding what level of basic . 
skills students need to 
succeed in a entry-level job * 
in my area ^ 3 

c. Finding and using ready-made 
standardize^ t^sts of 
students 1 basic skills 3 

d. Making and. using my own test's *■ 

. of students 1 basic skilis 3 

t * 

e. Interpreting the results of 
, ready-made^tandardized 

tests tojfeSess student, needs 
,ta'ba«i!fskills, '\ ' ~- ~ "3 

f. # ^Interpreting/the results of 
• V/ray own tests, to assess * • 

* ' .students! heeds in basic 
1 # . - skills •/ 3 

g. ^Finding and, usingT&terials . 

•^^^^d^meiEhods- to help yqca- * . 
.\i|fltipnai; students improve their 
. v> V&asiC; : 8E3U$s - -3k 
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Would like to, do 

To Not 
Very , some at 
well* degree all 



* 3 



1 
1 



0 



3 
3 

..,'3, 



2-, 



55- 



1 
1 



Can\<iq Would like to do 



* • /to Not To Not 

Very some at Very some at 
Tasks ; v ' veil * degree, all well degree all 

h. Planning prescriptive teaeh- , * 
ing ■ that will help stu- t 

dfents learn the basic skills^ t ;f' 

they will need on-the-job 3 2 ^1 3 2 .r* v 

i. Determining how readable «the c '~: 0 f * & * 
**W' textbook and other class 

materials aife in^the pro- 
gram 1 teach 3 2*1 3 ' 2- 

j. Finding out what levels of 

basic skills are needed * 
for jobs in the area i 

teach 3 2 13 2 

k. Teaching basic skills as an 
integral part of the voca- 
tional erducatita program 
I teach " % • 3 

1. Motivating student interest 
in learning ba§i.c skills 
through vocational educa- 
~ tion ' 3 



* \ 0 * . U 

7.* 'In any group of vocational education teachers, you are likely to find 
many opinions about teaching basic skills in a vocational education 
program. . - 1 + 1 

The statements listed belofo express both positive and negative opinions. 
All are based on actual statements made by vocational education teachers 

Circle one response for each statement to show how* much you agree or 
disagree with it. Remember that your responses are confidential. 



Strongly Strongly 
Statements * agree ** tmm ""^ dls^ee 



a. Combining vocational education with basic skills ♦ 
could help motivate students to learn basic skills SA 



8 
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b. Vocational education teachers can't be expected 
to correct In 2 years. what students have not been 

.taught previously by other teachjirs. SA A D SD 

• c. Vocational education teachers have a responsibility 

to make 'sure their gradating students have the \ 
* reading, aathematicarTand language skills they 
need to get an entry^level job In their area of 

study. SA A D SD 

d. Trying to teach basic skills In vocational jftograms Q 

will take too ouch time away from peaching Job- * * 

o related content. SA A D SD 

e. Most vocational teachers already do teach the 
basic skills that their student need to learn 

class lessons. 1 w % SA A D SD 

, - \ 

m f . Vocational education teachers should not have ■ * 

to become remedial reading or remedial mat he* * 

matlcs teachers. SA ' .A D SD 

" . . f 

g. Vocational educators should work with basic r \ 

skills teachers but vocational educators should „ 

not teach basic skills themselves, SA A D SD 

h. Most .vocational educators would welcome the 
chance to get tsome help in teaching reading, 

. mathematics, or language skills to their 

studente who need it. /» *' ' SA A D ■> SD 

\i , ' 

1. , Most vocational education teachers^ simply are ^ 
not prepared* for teaching basic skills as part 

of their classes. B SA A * D SD 

j. Combining basic skills instruction ; with vocational . . 

programs wil^ give students confidence in their * , • 

abilitiea. SA A D SD 

f . . , . v. . 

k. Teaching basic skills along with job content ^puts 

* an unreasonable burden jon the vocational teacher. SA ; f A D SD 

1. Teaching vocational students basic skills will • * 

help to make them more ^employable, s „ ( SA A D SD - 



Vocational teachers* should teach only "those basic . 
skills directly related to their technical areas.' „ SA A ^ D SD 

at Vocational education 'teachers. usually know which * 

students .need ? help In baslc> skills without using^s \ • ' 

tests in mathematics or English. 1 V* SA " . • A ' ' D SD 

* k> * / . « 1 • 

o. There are almost no resources available *to help 

the' vocatlohai'; teacher combine basic skills . 
instructiomtwith regular course work. ,SA ' , • A * D * SD 
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FIELD TEST 



BASIC SKILLS THROUGH VOCATIONAL EDUCATION 



GUIDELINES FOR -COMMENTS 
Teacher Version 



This is the field test of the Resource and Teacher Guides produced 
by the Basic- Skills Through Vocational Education Prdjectr. The people who 
developed these guides are seeking information which will help them re- 
Vise and improve the guides. * * 



One {bfvthe most important sources of such informatics will be your 
written doaments on the pages of these materials. As a representative of 
th$ kind^bf teachers for whom these materials^are intehdedv'ytiur. comments 



are especially important. 



When you come to a place tfyat*needs improvement, please ciccleor 

mark it boldly, and make some comment about it. Keep in mind that you can 

- - : J 

make several kinds of consents • You could simply state that a particular 

thing- is good or bad. Or you coiiild. go further and yrite a shor^t explana- 
tion abQut ttielcause of a problem in the writing". Or you could go further 
^stilj, and. make suggestions for improving or changing the materials.' 



To whatever extent you find it possible, please try to include 
"^ suggestions for improviiig the?content. Remember, however, that all 
responses are appreciated . u ' % * v 

. -- - ; ' m ■ I f s 



v In^ addition, we £sk 'that you BE BRUTAL. We*bel€eve that cfilticism 



will breed a better -product*? 



'At the end of the field test, the guides with your written comments 

*- * «« 

will" be collected. You will receive new clean copies in their place. % 

* * ♦ 

On the next page are* some suggestions for comments. Don't, feel 
limited by these. ^You may" write any comments you want. - 



Suggestions for Comments 



CONTENT 

. i * 
Is the content accurate ?- 

Is the content up-to-date? > ^~ 

Is the content appropriate for the needs of teachers ?'\ 

Does the content include) all 'relevant information and exclude all 

irrelevant " information? 
Ismail relevant information adequately- covered? 



CLARITY 



Are the objectives of the guides clear? 

Is the writing clear $nd understandable to you? 

Does the sequence of *the topics help make , things clear for youT' 

^ "j 
Do the examples arid illustrations contribute to the^clarity of the 

guides? 



ORGANIZATION 



Does the organization of the guides help you to understand them«and 
to use them? 

Is there another way of organizing the booklets or topics that would 
make them easier to undersjtjand or to uise? 



v -2 



APPEARANCE 



Are the guides attractive to read and use?* 
Are N there any typing or grammatical- errors?'" 

Does, the type style and page layout make the guides, easy , to read? 



PRACTICALITY 



What tasks suggested. ^ the guides "are not practical for* teaching 

in your school? In yojur^'District? In*your State? . * 
What tasks arg£nqt practical due to time, mS'ney,. oi^other reasons? 
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VALUE 



What parts are most valuable to you in planning instruction? 
Which parts are not valuable or useful? 



FAIRNESS * r f \; 



Is there any bias or discrimination in the guides related to sex, 

• * 

race, socio-economic status, handicap, or other characteristic? 



SPECIAL NEEDS 



Do the guides give adequate guidance on planning basic skills 

» • 

instruction for -groups with special needs such as the handi- 
capped or slow learners? 



v 



. 61 
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FIELD TEST . " \ 

BASIC SKILLS THROUGH VOCATIONAL EDUCATION ^ 



TERMINATION I^CUMENT 
Teacher Version 



This Termination Document consists of two parts. 

'Part 1 - Attitude-Skills Scale asks for information^ about yo>ir skills 
and attitudes with respect to. teaching basic skills to vocational education, 
students. 



Part 2 - Product^ Evaluation Scale asks for your ratings o 
Introductory Guide , the Teacher Guides , and the Resource Guide 



the 



Make yoiir responses Recording to fhe instructions, given for each 
section . - - 

Please remember that your replies are confidential.* 



rr 



Your Code Number 



.Date this dofcunlent Completed 



When you began this field test, you were asked how well yau felt, you 
coulH teach basic Skills in your vocational education classes. At 
that time you rated your own ability to do several tasks which a teacher 
might do who was trying ^to teach basic skills in a vocational education 
program* 

How well do you feel you can do these same tasks now, after using the 
guidebooks^* The, tasks are listed below. Circled two responses for each 
taak, one tq sfyqy how well you feel you can do the task now , and the 
other* to show if- you tried to use the guidebooks to help you do such 
a .task during the field* test. 



*£asks 



Can do this now 

" ; To Not 
Very some at 
well degree all 



Tried to do this 
) during, the 
field test; 



YES 



NO 



a.- Deciding what level of bas- 
* ic skills students need in 
order to learn in my 
classes. 

b* Deciding wliat level of 

,basic skills students need 
to succeed in an entry- 
level job in ..my area. 

c. Finding and using ready- 
,made standardized tests of 
students T basic 'skills. 



• N 



N 



N 



d. Making and using my own 
tests of students ? basic 
skills. * 



N 



'e.- Interpreting the results 
of ready.-macte ' standardized- 
tesjts to assess student 
needs in basic skills. ^ 



Interpreting' the results 
of my own t£sts to assess 
students' needs in basic 
-skills. ' ; 



Y N 



Y^ .N 
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Tasks , / 

Finding and using materials 
and metho^cte^to help voca- 
tional students improve 
their basic skills. v .. . 



Can do this now 

" Trf Not 
.Very some at 
veil degree all 



Tried to do* this 
during tltfe - 
field test 



YES 



NO 



N 



Planning prescriptive teach- 
ing that will help stu- 
dents learri the basic skills 
they will need on-the-job. 

Determining how readable,,the 
textbook 'an£ other class 
materials are in the programs 
I teach. A 



•N 



Finding out what levels of 
basic skills are needed for 
'jobs in the area I teach. 



N 



Teaching basic, skills as an 
.integral part^of the voca- 
tional education programs I 
teach. 



N 



Motivating student interest 
in learning basiQ ski Ms 
through vocational education. 3 



N 
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When the field test began, you were' also askfed to agree or disagree 
with a number of opinions about the possibility of teaching basic 
skills in a vocational education- program. 

How do you feel about these same opinions now , after using the guide- 
books to help you teach basic skills in- your classes? 

The same positive^ and negative opinions you saw at the beginning of 
the field test are listed bslow. Circle one response for. each state- 
ment to show how much you agree or . disagree with it. Remember that 
your responses are confidential. 



Statements ' 

a. Combining vocational education with baaic skills 
could help motivate students to learn basic skills 

b. Vocational education teachers can't be expected 
to correct in 2 years whet students have not been 
taught previously by other teachers. 

c. Vocational education teachers have a responsibility 
to make sure their graduating students have the- 
reading, mathematics, and language skills they 
need to get an entry-level job in their area of 
study. 

d. - Trying to teach basic skills In vocational programs 
v will take too much time away from teaching job- 
related content. 

e. Most vocational teachers already do teach the 
basic alalia that their students need to learn 
class lessons. 

f. Vocational education teachers should not have 
to become remedial reading or remedial mathe- 

• matics teachers. f , 

g. Vocational educators should work with basic'' 
skills teachers but vocational educators should 
not teach baaic skills themselves. 

h. Most vocational educators 'would welcome the 
■^chance to get some help in teaching reading, 

mathematics, or language skills to their 
students who need it* - -V 

m 

1. Most vocational education teachers slapjly are ^ , 
not prepared for teaching basic skills as, part " . 
of their classes. \ 

j,,. Combining basic skiUs- Instruction with vocational 
program* will give' students confidence ln*heir 
abilities, * 4 * 

k. , Teaching basic skills along with job content puts 
JSan unreasonable burden on the vocational teacher, t 

1. . Teaching vocational students basic skills will v 
help to make fchesi more employable « *^ 

a, t Vocational teachers should teach only, those basic 
*• skills directly related to' their technical areas. 

n. Vocational^ education te^^ers usually know' which 
students need help In basic skills', without using 
tests in mathematics or ^English. 

f ; • . • " * ' r 

o. 'There are almost no rtaovrcta available to help 
the vocational teacher combine basic skills 
Instruction with regular course work* 



Strongly 
agree 



SA 



Agree 



Disagree 



SA 



SA 



SA 



.SA 



SA 



SA 



SA 



SA 



SA 



SA 



SA 



SA 



SA 



SA 



D » 



Strongly 
disagree 



SD 



SD 



SD 



SD 



SD 



SD 



SD 



SD 



SD 



SD 



SD 



SD 



SD 



SD 



Part 2 - Product Evaluation Scale 




troductory Guide. 



Section A - Rating the Introductory Guide 

Below are a number of statements 

Indicate whether ^you agree or disagree wi th each statement^or if you have 
no opinion. Circle one response for each statement at.the right. 
(Consider only the Introductory Guide . You will rate the Teacher Guides 

Don 1 t Know 
No opinion 



and the Resource Guides in the next two sections.) 

Agree 1 Disagree 



1. The Introductory Guide is essential 
for understanding and using fhe 

other guides.-. » 

2. All the information in the guide was 
correctT. » ° 

The guide included all relevant infor- 
mation that it should have 



3. 



4. * The guide was direct r^nfl torthe-point. . A 

5^; The guide was easy to read- A 

6. The* guide had no hard-to-undergtand. 

' jargon A 

7. ^The guide gave practical advice? A 

8. The guide addres-sed current issues in » 
helping students with basic skills A 



9. 



10. 



11. 



The guide helped in 'building a team to 
plan instructional activities 

The graphics and diagrams in the guide 
helped me to understand the guide 

The examples given i$ the guide were 
realistic and helped me to understand 
the content *. . • 



12. The guide gives adequate guidance tq^ 

administrators iW managing the people, \ 
, time, and resources for basic skills 

in vocational education classes ; A 



13. 



. t0h' : ■ 

The guide should, help to motivate 

teachers and administrators to teach 

basic skills in vocational .education 

classes. ^« » . «- 



14. The guide. has a attractive format.,.,. 



15. The. guide was cl'early written. 



A 

A 
A 



D \ 



D 
D 
D 

D 
D 



D 
D 
D 



\ 



4 



I.ER1C 



'•'/TV 
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How mudh did the Introductory Guide help you-, do each of the following? ^ 
Circle your response at the right. 

^ . . ' ■ Some- Not 

- How much did the Introductory Guide help. you, A lot what nuch 



16: Recognize the importance of teaching basic skills 

through vocational education programs? : . * 3 . *2 1 

» • 

17. Understand fthat vocational teachers can do to teach 
.basic skills in their program?/. «••••••<;•••'•*•• - 3 2 1 

18. Understand how to use "the* Teacher Guides!? , 3^ 2 1 

19. Understand how to use the Resource Guides? 3 * - m S 2 1 

20. Realize the advantage and limitations of the 

Teacher- and Resource Guides? 3 2.1 

21. Ui^derstand how the other guides or organized? , . 3 2 1 

22. Be cony;Lnced that you could teach^basic skills 



in vocational programs w 



,3 2 1 



23. Plan basic skills instruction for your particular 

vocational speciality? 3 2 1 



24. Understand the content of the Resource and 

Teacher Guides? **3 2 1 

'flow useful were each of the* fol^wing -chapters in the Introductory Guide ? i 
Circle your response at th£ right. o \ 

* - * Very * Somewhat Not. 

useful u seful useful 

25. Section I. Why Basic Skill Development Through 

" Vocational Education? ♦ 3 2 1 

• < > , 

26. Section II. Giving* Teachers and Students Power... 3 2 1 

4 " 

27. Section III. Using the Guides 3 2« 1 , 

28. If you had the .job of^r£vising the Introductory Guide ,so as* to make it 
more useful, attractive, or easy to read, what would yon do? * 



At* 
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Section B - Rating the Teacher Guides * , . 

Listed below are the titles of the f our'. Te'acher Guides , .Which ones 
did you read or use or both? Circle your answer at the right. 

. I *** £ead and Read it but , Neither read J 

' If used it i didn f t use it nor used it 

i . 

1. Developing Readirig* Skills 

• Through Vocational Education 3 2 1 

2. Developing Mathematics Skills, 5 « • ^ 
Through Vocational Education. # . ... 3 . ' 2 k 1 

3. Developing Writing Skills 

Through Vocational Education 3 m 2 J 

• ' t '\ I ' * 

4. Developing Listening: and 

% * Speakihg 'Through- Vocational 

Education 3 2,1 

Listed below are a number of statements about the Teacher Guides . 
An abbreviated title for, each guide is at the right. Uritfer the title of 
each guide, which you read or used , write in whether you agree or disagree 
with that statement for that particular guide. Use these' symbols: 

. - \ • • ' - " 

A - I agree with this statement 
D » I disagree with this statement 
? » Don ! t know or- no opinion 

Remember, write in one of the three symbols for each statement but rate 
only the guides you actually read o'r used in planning basic skills instruc- 
tion in your classes. 

' Mathe- Listening 

> Reading matics Writing 'g* Speaking 

5. This guide helped me jund^rstand the . ^ — 
content of this basic skil*l ♦ . 

i 

6. This guide helped me)to understand 
how this basic- skil^jis related . . % 

to my vocational specialty.....*- " - 

V - . .f v ■ 

7. This guide gave me gqod advice on 
lesson planning *f or Reaching basic 

skills, in my classes; . . . < 

- * >• , . 

8. ^ This guide gave me gcjfod advide on. , ; 

adapting my lesson p^ans to include* ^ 
basic skills instruction 1 ♦ . [ 

f TDT/page/6 •' 
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l 

^ Mathe- " , Listening 

1 ■ Reading matics Writing ' & Speaking 



9. This guide showed me how to^ cope with 
factors that affect the development" 
of basic skills in my. students 

10. This guide gave me good advice "on 
selecting the- basic skills related' to 
my vocational speciality • 

11. This guide helped me specify 
objectives for basic skills lessons... 

12. This guide* helped me select or 
develop instructional strategies for 
teaching 'basic, skills. 

13. This guide helped me locate or 
create tests and instructional 
materials in its particular basic 
skill 

14. The content oi; this guide was 
accurate 

15. The content of this" guide was clear 
ffca^e.... • V '" 

16. All necessary content was included 

in this guide : 

17. The guide .was easy to read. . . . ; 

18* The" guidef generally gave practical 
, advice for instructional planning 
for teaching basic skills >. 

19. this guide meets the^bjectives 

that it stated *\ 

20. This >guide f s objectives were clear. .. . 

21. The illustrations in this guide help 
make the 1 content clear..,...- t . 

22 0 • ThisJ guide caii be used for planning • 
basic skillsj instruction 

. a. in most schools •■ 

b. at different grade levels.-..!.... 

c. ' \±n different. vocational areas.... 



<J.- ; l>y .teachers with different- 
':} training and' experience. 

. * ' . * - * : ' .J TDT/pase 7 
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:Mathe- listening - 

1 Reading matics Writing & Speaking 



23. This guide -requires in-service % 
training fgr teachers to usg it ■ 

• successfully ;^ 

24. . This .guide is directly related to '* . 

* needs and demands of teachers and % . 

administrators j \ 

25. This guide is very valuable for^ 

teachers and administrations..;..* ^ m 

, . • ' • ' • * . *• 

26; This guide shows no evidence of bias 
j ^ with regard to sex, race,) or socio- ■ 

economic" status of students. ... i * : 

27. "This guide should be* equally usable 
by teachers, of differing education 

and background 



28. This guide gives adequate guidance 
for planning basic skills 
instruction for 

handicapped students 

gifted students 

other students with special needs.. 



29. 4 This guide is potentially useful for 
planning basic skills instruction j 
for adult education, classes." 1 — A 



.30. It was easy to integrate the prbced- I 

. ures suggested in this guide w£th * 
other schopl curriculum and' testing " ~ 
programs * A .• • • • • . , . 

31. About how many hours per week did you use each of .these in making 
. ! instructional plans? How many hours of classrqom instruction did this ) 
affect? Write in your best estimate of average hours ?t. the right. / 



— y , Hours used £n , Classroom 

\ planning hours y 

instruction affected 

a. Developing Reading Skills. _ 

b. : Develbping Mathematics Skills . 

c. Developing ^Writing' Skills ...... ^ 

d. ' .Ceveloping .Listening and Speaking Skills.^ ; ' j 
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ft ■ ■ 

If you had . the job of revising these'' guides so as to make them more 
useful, attractive - , or easy to rea'd, what would you do? Make separate 
suggestions for each guide.* & • 

a. Developing Reading Skills Through Vocational Ed ucation. 

■ \ 1 



T 



b. Developing Mathematics Skills Through Vocation al Education. 



c. Developing Writing Skills Through Vocational Education. 



,'d. Developing Listening and Speaking Skills T hrough Vocational Education. 



... 7i 
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Section C - Rating the Resource Guides 

Listed below are the titles of the 12*- Resource Guides , Which ones 
did you read or use or both?' Circle your answer at thd right. 

Read and Read it but Neither read 

used it didn y t use it nor used it 
7— — ^ 

I. Basic Skill Domains and Voca-^ 

tional Education Areas: Creating 

Skill /D.O.T. Job Title Matrixes 3 2 1 

II. Instructional Materials for 

Teaching Particular Skills...* 3.2 1 

III. Tea«hing Particular Skills for 

Particular Jobs ■ 3 2 1 

IV. Testing and Basic Skill Develop- 
ment Through Vocational* Education: * \ 
References * 3 2 1 

V. Determining the^Reading Level of 

Vocational Education Texts 3 2 1 

VI. Teacher-Made Tests and Other 

Informal Diagnostic Procedures 

Used in Vocational Education.* 3 ^ 2 1 

VII Basic Skill Development Procedures 

for Special Needs .Student^ in S 4 

Vocational Education Settings.. 3 2 1* 



4 



VIII. Technical Vocabularies 3 2 1 

. IX. Minimum Graduation Requirements: , *• 

A Comparative Summary. ... ............. -3 * 2 1 

*' 

X.- Building Support for Testing and . . t 

Teaching Basic Skills, within 

Vocational Education ' Contexts. . 3* * 2 1. 

XI. Resources for Remediation of Basic , ! 

Skills within Vocational.^ Education 
' Centers * . ,. ' s 3 4 2 / . . 1 

XII.- Resources for the Reinforcement o£ 
. , Basic Skills and- the Accommodation \. * 

of Studehts : with Basic Skill 
I ^ Deficits lit Vocational Education, . , . 

Settings* .\ ....... .i ........ :. ;3 2 , 

ft ' # • 1 
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COMPLETE ONE COPY OF THIS PAGE FOR EACH RESOURCE GUIDE YOU READ OR USED. 

. r . « ■ . . • - ' 

Circle Ehe number of the Resource Guide you are rating in the questions 
-•sjjfelow* Refer to the list in the beginning of this section for the titles 
that correspond to the numerals below* 



I II ' III IV V VI VII • VIII IX X XI XII 

For the one guide you have circled above, answer the following ques- 
tions by circling your .response *at the 'right. * 

• ' Dis- Don't know 
^ • Agree agree No opinion 

a. The purpose and objectives of thxs guide 



were clear to me . . . A D ? 



b. The content of this guide was clear to me A D 



? 



c. The content of the guide was easy to read and 

understand A D ? 

d. Thisiguide* can be useful in helping teachers 
to plan basic skills instruction in voca- 
tional programs S A D ? 

e. The content of this guide was accurate and 

complete A D ? 



f. "I fefel I gained new knowledge from this guide... A 



D 



? 



g. The information or "procedures described in 'this 
guide could be integratecPwith current school 

practices in my school or district A D ? 



gj I feel that I would need in-service training to 
' • make effective use of this guide A D 

i. Describe briefly exactly how you used this guide in planning or 

conducting basic skills instruction in your classes. If you are, an 
administrator, explain hpw it helped you plan and lead such instruction. 



I j. If you had the job of revising., this guide,' so as to make it more useful, 
attractive, or easy to read /what would you do? Write your suggestions 
on the lines below. >| 



fvERIC 



- 1 *C ' 
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FIELD TEST " . 

BASIC SKILLS THROUGH" VOCATIONAL EDUCATION 



TEACHER INTERVIEW 



This interview is to be 'conducted by ttfe Field Test Coordinator t at a ? time 
and place convenient to the person being interviewed, 

v At the top of each page is a ma/jor question* Repeat- this questioiflaloud 
to the person being interviewed ♦ Beneath each question are several probes, A 
intended to show the direction and content of this, line of questioning* 
Use these as the basis for further questions to get the interviewee to 
expand on his/her answer and to give more detail. In all the questions, 
seek specific details and examples* / 

' Room has been left on each page for you to record the person's 
responses during the interview. These written notes should be. typed after 
the interview for future reference* 



Person being interviewed^ 



Persoa conducting interview ; 

Site code number ' Date this form completed^ 



1. Which guides are you most f.amiliar with? -Why these? 

Probe for: _ . - „ - /v « 

a. Titles of guides actually used in planning and conducting 
: - classroom* instruction. * « « 

b. Titles of guides, which person read or is otherwise familiar 
with. * 

c. Reasons why other guides were not used or read. 



2._ On the whole, were the materials clear and. easy to reacH 

Probe for: ] 

a. Clarify of objectives 

b. Clarity of content 



c. How 'sequence -and illustrations affect clarity 

d. ^ 

e. Which portions 



I.. Differences among guides with respect to clarity* - 
>. Which portions were the clearest. *( 



V 



mm 



11 



'ERJC ^> 
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3. Was, the content adequate and accurate? (Note to interviewer: "Content 11 
here means the^facts, procedures, methods, research, etc. presented, as 
contrasted with the style and organization dealt: with in the previous 
question.) - 

Probe for: 

a. Completeness of content 

b. Relevance of content for intended outcomes 

c. Content that is present but not needed. 




4. Consider for a moment only those guides yau actually used (or tried to 
' use) in planning^ or conducting instruction. How did you use them? *; 

Probe for: 

a. Outcomes being tried for 
» b. Actual experiences and examples 

c. Differences in using guides with* varying classes, students, or courses 

d. How instructional practices changed. 




5. What problems did you encounter in using the guides? What problems do . 
you.-thiiik others might encounter? 

' \ . ' ' 

Probe for: * * 

. a. Specific tasks which need clarification; adequacy of guidance 
throughout guides. 

N b. Difficulties in integrating test and other procedures outlined in 
the guides with othfcr school. curriculum and testing programs? j 

*A ***** 

|c. Need for experience, education, or. in-service training for effective 
use of materials. - ^ 

d. influence of pupil characteristics on effective use. 



6. Did you find these materials to be practical to use? Do they work? 
Do you think others will also find them to be practical? And why?, 

Probe for: 

a. Time, money, and other resources which were needed to use guides « 

b. What resources were needed but not available. 
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?• Did you find any examples of bias, against\ teachers or students due' to 
sexism, racism, or -other forms of bias in the materials? 



82 
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Do you feel that these Materials give teachers and administrators 
adequate guidance for planning and conducting basic skills, instruction 
for special needs students, for example, handicapped, slow learners, 
etc. Can these materials potentially be used £o incorporate instruction 
in adult education clashes? 

! : 



83 
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» * t 

9. 'What do you think would be a reasonable sales price for the materials? 

I #>; 

Probe fork ^ 

. a. The price if school f jinds were being spent, 
b* The price if the .interviewee were spending personal funds. 




10. Overall, in summary, what impact, do you thinly these guides could, have 
on vocational education? Do you think they are valuable? 

Probe for: • 



a* ' Relation of materials to significant needs and demands of 



education personnel. . ^ 



b. Perceptions o£ possible qffects on teaching practice. 



•""ft . 
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FIELD TEST. 



BASIC SKILLS THROUGH VOCATIONAL EDUCATION 



ORIENTATION DOCUMENT 

8 

Administrator version •< 



The Orientation Document consists! of two parts. 



Part 1 - Participant Information Scale concerns your work experience, 
educational dnd professional activities, and' general background^ 



> Part 2" - Attitude-SkirllsySCkle' asks for information about your skills 
.and attitudes witji respect; toAJTeaching basic skills to vocational education 
'students. 



Check Qr circle your response, or write in a brief answer, according 
to the instruc£i*rt!s given* for. each quest ion ^ 




-Please remember that your, replies -are confidential. 



You* Code Number * 



Date this documen 



* .1 " .• -■ 

ent completed" 



»- > 



1. 

2. 
3. 

4; 



PART 1 - PARTICIPANT INFORMATION SCALE 



or Question^ 1 to 4, write in the number of years indicated. 



How many years have you been employed by this school district? . 

How many years were you employed in other districts?. . . . a 
In how many other districts have your workfed? £ yft yj i! ^ 



In how m^ny other schools have you worked, in this districts # „ 

or in other districts? JlWfc -' vAj! ^ 



5. HaVe you ever held, or do you now hol&^any of the following positions? 
If you have, how many years did you hold that position?.' z l 

Circle your answer »to show if you ever held that TOsif;"ion»> Write \ln r + ^9 
the number of years youhelditr to the right. / t"// ' ' * * 



9 r 4 



1 



Position 



I- 



a. Teacher ...... 

b. Department Chairman 

c. -Assistant Principal 

d. Principal ^ 



\.Haygryou , ^^usaber of 
^Ijeid this ^ jfkax^.jia* c 
'position? *V ^ ^osilEion 



e. Central District Office Acbainistrratorr / .Yv -N 

f. Other school distri^^positiqa. ^; ♦ J^-y-^S- * '="""-■ $ 

If o you answered' 




th 



position tttie(^ ^ergi;^ t. 1 '- "^55; ^ j. 



w 1 * 




v I. > 
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Check, circle, or write in. : your answers as indicated for each question 
in this section, ; , * 

6. What is the highest degree you have actually received? Check one, 
a . Bachelor's degree 
. b. Associate* degree in a technical subject 



jc. Master's degree 
_d. Ph.D. degree 



e t Other - specify 

In what year did you receive this degree? 



7 



8. What was the major sub j ect area'.of this degree 

9. " Are you currently ^working towards a higher degree than the one you 
now have? Check one.' "If yes, write in the subject area of j^our 
studies. * ^ . \ \ 

a. No ■ 9 

~* » b . Y4s. What is the subject area your degree will^be in? 

/ * ; ja >_ 

10. Do you currently -jros&gss any licenses, either as a teacher, an 

.administratis^ or. other professional position, or as a craftsman? 
0 4 Write -in-t&Vnan^of these licenses -below. 

■ J:' t ' \^ -■- — " — ~~ — p — 

11.1 List the naiyts of * the professional organizations of which you are 
*\ • - durrently a meinber. 

: . ;;-:*. '. % ; '. 



^?2tetr.i£hB names o£ no more than three professional educational journals 
V~ -~ r ~ !: -!l^S1^53^U>^Sa on a regular basils. ■ 



U - -<r -Z- . - . . a 



•'" .-: 11 . • • - \ 
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Have you ever had any training or, experience working with the kinds 
of .students listed below in occupational or vocational education? 
If youJiave,- circle T c|c -E'or both, - as appropriate, t s 

TrMMpg can include any formal instruction, such as. college courses, 
in-service workshops, or othei£ instruction 1 Experience includes 
work with students as either a teacher or^an administrator. I 

Student groups % ) 

a. Gifted students . .*„ 

tb. .Students with learning disabilities. 

Slow learners 

Physically handicapped students. . . 

Disadvantaged students .* 

'Students with, low reading ability. . 

.Students with low mathemathics ability^-. 



c. 
d. 
e. 
t. 

g- 
h. 



Training 
T 
T 

. _ T 

. T_ . .. 
T 

V 

T '- 



Experience 

' E 
E- 

— E 
E 

E 

E 

- _e.:. 



"Students w£th low ability in language 
areas* such, 'as writing, ^speaking or * * -* 

listening/. . c ... E , 

i. Students with other kinds of learning .... 
. . difficulties ....... . 4 .... • T E 

' . . ■ \ ■ . 

♦Have you ever worked with teachers of academic basic skills (such as 
English and mathematics) to improve the reading or mathematic skills 
of your vocational students? Check one. 



a* 



No. . 
tes. 

! 



Describe briefly 



-Have you ever,. worked with other vocational teachers?* to help improve 
your^students ^ skills in reading and mathematics? Check -one. \ 

/a. .No. 




b. Yes. Describe brief ly . 



t. • 



•• v 
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PART 2 - ATTITUDE-SKILLS SCALE 

In your administrative work, are you primarily concerned with one area 
of vocational education (such as a department chairman of distributive 
education) or are you concerned with.all areas of vocational education 
(such as 'a principal or central office administrator)? Check one answer 
below and follow the indicated instructions. 

a,. Primarily concerned with one subject 

area in vocational education . .. .Go to 
Question 2. 

b.' Concerned with several* areas. . .Continue 

with Question 6. 'Skip Questions 2, 3., 4, 
and 5 . 

• 

Which of the following general areas of vocational education are you ' \ 

most concerned with? Check 'one. 

» 

" a. Agriculture • and agri-business 



b. Business and office education 

. T • . • • . 

c* Distributive education 



'd«X«Health educatiqi 

e. Occupational home economics 

f . Technical- education 



; g. Trades and industry 

» \ > 

2 .'. h*. Other specify 



Wli^-t specific programs in vocational education are you concerned with 
J ta youir administrative duties? Write the names of the courses with 
the largest entollments pn the linesrbeldtf ' 

a. , ^ 



c • 



What specific kinds vof j\obs t c6uld a student get;. .^rfaorhad'. taken these \ 
programs? Write one or more examples of Job titles, on. £he lines 'below* 



b. 



^DA/page U\ , 
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In general, £hat minimum level of basic skills would a graduate need 
for success in an entry-level position in the kind of jobs such as 
those you listed in Question 4? Circle one response for .each of the 
five basic skills listed. belqw. 4 . - 



Minimum level needed 





Academic basic skills 


Very high 
; level 




Average 
, level 




Very 
low 


a. 


Reading 


i 5 5 

/ 


4 


3 


2 


1 


b.- 


Mathematips - 


A. , 


. .4 


- 3 


2 


1 


c. 


Writing, English 
• composition' 


5 


4 


3 ~ 


2 


1 


d. 


Listening j ■ 


* 


i 


§v 


2 


1 


e. 


Speaking \ 


5 


4 


3 


I 2 


1 



How much trailing and experience have you hkd in teaching basic skills, 
such as reading, njathematics , and so on, including supervising, motiva- 
ting,* and supporting vocational teachers teaching basic Nskills in - 
their- classes. ~ ' ' 

Listed below are several .tasks that might be associated with efforts 
to include basic skills teaching . in vocational education glasses . 
Circle two responses for each task, one for your training and one 
for your experience. . ~ / 

Training in these tasks, or: providing administrative support for these 
task's, can include college, courses, in-seryice workshops, or 'other * 
formal training you jiave had, - - . ' ". . 

Experience means what yojLi. have done, either, as teacher or administra^ • 
tor, to try to apply these tasks/ c 



Training 



i Not 
lot Some much. 



Tasks 



deciding what level ^f basic * 

skills^students heed in. order 

to learn in their classes. 3 2 

Deciding vhafc . level of basic 
skills students need to suc - 
ceed in jgn'^entry- level, job in; . 
•a particular area?' 1 • I [ - 3 . 2. 



Experience 

"A ] Not* 
lot Some* much 



v 1. 



3 r % r ' .i I 
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training 



•Experience 



A Not A . Not 

Tasks 9 lot: Some milch ' lot Some. - much 

Finding and using ready-made 

standardized tests of stu- " ' » 

dents' basic skills . § . 3 2 1 3 2- 1- 

Designing and using teacher- ; 
made tests of students' 

basic skills. 3 2.1 3 2 1 

i 

Interpreting the results of 
ready-made standardized tests , 
to assess student needs in 

basic . skills. 3-2* * 1 3 2 1 

Interpreting the results of 

teacher-made testis to assess * . v 

students' needs in basic • j f ;j 

skills^ * 3 2 1 3 . 



Finding and using materials * < 
and methods to help voca- ./"'"" 
tional students improve » ) 

their Vasic 'skills. ' - / 3 J^L 1 3 

Planning prescriptive teach- 
ing that will 4 helg students, 
learn th£* bjpsic "^Llls they 
will . need * .ciAttie- i ob . * : 

Determining how readable the- * 
textbooks aid other class 
matefialsi are in vocational 
program. - 

Finding out' what levels of 
basic skills are needed for - t 
jobs in various" areas*. '* 3;> 

Teaching basic skills as an 
integral »part ^f vocational 
education program.. *4u> -3 

Motivating student in learning 
basic skills through vocational 
educatiori. 3 . 
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How well, do you fee.1 you -can mptivfcte and support teachers to^teach 
basic skills in their vocational education classes? How well would * 
you like to be* able to motivate and support such instruction? 

The list of tasks from Question 6 is repeated below. Circle two 
responses for each, task, one to show how well you feel you cafa motivate' 
or assist teachers in doing such a -task, and one to show how well you- > 
would like to be able to assist them in doing the task. 



Tasks 



Can motivate 
and assist 

— To Not 

Very - some at 
well degree all 



a§ -Deciding what level of 

basic skills students need 
in order %o learn in their 
classes. 



Would like to 
assist 

To Not 
Very some at 
well degree all 



3- 



-2- 



9 
C. 



Deciding what level of 
• basic skills students need 
to succeed in^ an entfry- 
level job in a particular 
area. ^ 4 

Finding and using ready- 
made standardized tests of 
students' basic skills. 



1 



Designing and using teacher- 
made tests of students' 
basic skills./ 3 '~**n 2 



Interpreting the results of. 
ready-made standardized 
tests to assess spudent 
heeds in basic skills. 3* J ? 2; 

Interpreting 6he resists of 
teacher-made tests to assess 
students' needs in basic , 
skills. " ' " • . 3 • 2 



; i 



3 2 



Jin ding and^CSing materials 
and metliodsi.to^Help voca- . ^sy- 
tional students improye. theiiM- 
tjasic skills^'^; tm ' s 3 
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Can motivate 
and assist 



.Would like 
assist- 



to 



To 



Not 



Tasks 



-To Not 
Very ;some . at Very some . at 
well de gree all ' well degree all 



h. 'Planning prescriptive teach- 
ing that will help stu- 
\ dents" learn the basic 
, skills they will need on- 
the-job. 3 



Determining how readable, 
the textbook and other' 
class materials are in voca- , 
t^onal programs. 3 



_J>,_ 



Mi 



Rftiding out what levels of 
basic skills are needed "for" 
jobs in ^various areas. 



k. .Teaching basiif skills as an 
integral part of vocational 
education programs. 



2# i 



' 2 



1 



1 



1. Motivating student interest 
in learning- basic skills 
through vocational educa- 
tion. 



v 
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In any group of vocational education teachers and administrators, you 
are likely to "find many opinions about teaching basic skills in voca- 
tional education prpgrams. 

The statements listed, below express both positive and negative opinions 
All are based on actual statements made by vocational educators . 



Circle one Response for each statement to show how much you agree 
disagree with it. "* Remember that your .responses are confidential. 



or 



Star 



.a. Combining vocational education with basic skills 
.could help motivate scudancs co laarn basic skills 

b. Vocational aducation teachers can't ba expected 
to correct in 2 years what students have not bean 
taught previously by other taachars. 

c. Vocational aducation teachera hava- a re s po nsibil ity— 
to make sure their greduating students have the 
reading, mathematics, and language skills they [ 
need to gee an entry-level' Job 'in their area* of 

study. 

d. Trying to teach basic skills in vocational programs 
will take too much tine avay from teaching job- 
related qontent. 

e. Most vocational teachers already do teach the 
basic skills that their students need to learn 
class lessons. 

f. Vocational education teachers should not have 
to become remedial reading or remedial mathe- 
matics teachers. 

' n 

g. Vocational educators, should work with basic 
skills teachers but vocational educators should 
not teach basic skills themselves. 

h. Most vocetional edijcetors would welcome the 
chance to get soma]' help in teaching reading, 
mathematics, or language skills to their 
students who need it. * 

i. Most vocational education teachers simply ere* 
v not prepered for teaching baaic 'skills as part 
v s of their classes. 

-« J 

j, ^Combining basic" skills instruction with vocational 
programs will give students confidence in their 
abilities. 

a*, 

k. Teaching basic skills .along with job content puts 
an unreasonable burden on the vocational teacher. 

1. Ttechlng vocational students basic skills will 
* help to" make them more. amp loyeble. 

af Vocational tea*chers should teach only those basic * 
skills directly related to their technical areas. 

n. Vocational eflucat^on teachers usually know which 
students need halp\^6aaic skills without using 
tests in mathematics'or English. * i 

M ' «5 ' \ ' 

o. There are almost no aeiources available to help 
tha vocational' taaowir combine basic skiile ' 
instruction With .rigila*** course vor>, 

m • ' : < * ' i . . ' ; . • 



Strongly 
agrae 



SA - 

SA 

\ 

\ 

SA " 

SA 

SA 

SA 

SA 

SA 
.*SA 

SA 
, SA 

SA 
. SA 

SA 

'SA 



Agree Disagree 



« D 



D 



Strongl! 
disagree 

SD 



SD 

SD 
SD 
SD" 
SD 

sb 

SD 

SD, 

SD 
SD 
SD* 
SD 

SD 

SD 
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FIELD TEST 



BASIC SKILLS THROUGH VOCATIONAL EDUCATION 



GUIDELINES FOR COMMENTS 
Administrator Version 



This is the field test of the Resource and Teacher Guides produced 
by the Basic Skills Through Vocational Education Project. The people 
who develpped these guides are seeking information which will help them 
• revise and improve the guides . 

. 4 An important source of suc^i information is your written comments on 
"* the pages of these materials. Even if you do not use them in planning 

instruction* we ask* (hat you read through the guides, completely and write 

comments. As a representative of the kind of administrator who could tfse 
x the guides, your comments are, especially important. Consider not only your 

own vi^e*£S, but also how you think teachers would re&ct to the materials. 

When you come to a place th^t needs injprovement , please circle or 
mairk- it boldly, and ui^ke some, comment about it. Keep in mind that you can- 
make: several kinds of comments «\ You could simply state that a particular 
thing is good^or\>adi Or you cohld go further and. write a short explana- 
tion about dhecourse,of a prQblem irithe writing. " Or you could go further 
; Still, and nake suggej^ioijs for improving or changing the" material,.! V 

* » • » , s • 

» •- * **** *' , • * 

^ ' To whatever extent you find it possible, please try, to include sug- 
gestions for improving the content. Remember -however, that all responses 



are 'appreciated . 



sponse 



v ' - 

\ 97 " * . - : 

\ . * « or 

' .-V . \ • ■ , ...... « , • 



1 



In addition/ we ask, that you BE BRUTAL. We believe that criticism 
/ - ^ 

will breed a fetter product, * r • 



At the end of the field test the 'guides with your written comments 
.will be/collected. You will receiye new clean copies in their placet 



q. / On the nextopagfr^are some suggestions for Comments. Don't feel 
limited by these, xou may' write any comments you want. 



\ , 



t 



V 



V 



! 



or* 



» i 
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CONTENT , o 

Is the content accurate? • . 

Is the content up-to-date? 

Is the content appropriate for the needs of teachers' and administrators 
Does ^he content include all relevant information and exclude all * 



s irrelevant information? 

t » « 

\s all relevant information* adequately covered? 



'CLARITY 



Are the objectives of the guides clear? 

la thi^writing^ clear and tinders tandalJle to you? 

Does the sequence of the topJLcs heip make things clear for ^you? < 
j' Do t4e examples and illustrations contribute to the clarity of the 

a f 

guides? « 
ORGANIZATION - * , • 



Does the * organization c^f^h&^uides help »you to understand them 

and to* use them? % * 

Is fehere another "way of organizing the booklets or topics that would 



make them easier to understand or to use? 

APPEARANCE . , ' 0 . 

' ' ' * ^ 

Are the guides attractive to read 'and to use?* 

Are there any typing or grammatical errors? 

D^gs £he type style and page layotft make'' the guides easy to read? 
* 

"practicality v . ■ 

What tasks suggested in the guides are not practical for; teaching 
\ • or administration in your ^school? , In your District? \ • 
» What tasks are not practical du£ to time> qioney; or oth^" reasons?. 
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VALUE - - ■ • , L * \ 

t * * * " ' 
What parts are most v valuable to you in planning or administering 

* • 

instruction? - 
\ Which parts are not ( valuable, or useful? " \ 

•«. • • • • - 4 . „ . ' 

FAIRNESS : * 

Is there ; any bias or discrimination in the guides related to sex, - , 
race, ^socio-economic status, handicap / or other characteristics? 



SPECIAL NEEDS 



Do the guides give adequate guidance on planning* or administering 
basic skills instruction "for groups with special needs such .as 
the handicapped or slow learners? , , 



v 



OQ 
i> O 
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V. ," FIELD^TEST ' ^ 

BASIC .SKILLS THROUGH VOCATIONAL EDUCATION 



TERMINATION DOCUMENT 
Administrator Version. 



4 

J; •■ x ^ 



The Termination" Document consists df tWQ parts i v 




• ''.Sake your Vesponpes according .tq^tbe instructions given for each, v r;; t . * y 
sect ion. . * • Y »' , , v ■• t .- * >tfy ,i| 

Please remember -that* your replies /afe confidential. 



Your £ode Number* 



. Date this document completed 





r- v . 
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" * -Piirt 1 - Attitude-Skills Scale 

When you began this field test, you were asked how well you felt you^ 
, could Motivate and support teachers to teach basic skills in their voca- 
,_£ional education classes. At that time you rated your own abilities 
to motivate or assist teachers in doing several tasks associated with 
'teaching basic skills in vocational education programs; 

How well do you feel^you can- do these same tdsks now*, after working with 
teachers to. use the guidebooks? The tasks are listed below. Circle 
two responses for each task, one to show how well you feel you can 
motivate and assist teachers now , £nd the other to show if you tried 
to use the guidebooks yourself or in working with teachers to do such 
a task during the field test. 



• - * " * « -Tried jto. do this 

j • Can 'motivate -during -tjife / % ' 

<k and assist „ ' fields tept.-/' 



~ m * * '** To " Not .... j? V \ 

' ' ' * yavy % some. at* r "YES * ^ + $0* 
Tasks . , ; « , > ' well * degrfee^ " all * £ 



Deciding what level' of basic \ *• „ • y 

skills students need iii or*v * ^ / • » ^ 

# der to learn in their ' * 3 ,2 1, Y • « . N 

classes. . . * '* - 



£T. -Deciding what level of bas-: 
, ic skills students need to 
i succeed in 'an entry-level * 
, job in a particular ax;ea. 

c. Finding and using ready-made 



Y.* N. 



standardised tests of stu- 
' dents 1 basic skills. • » 3 . 2 ■ 1 .*? . , N 

d. Designing and using teacher- 

made tests of * • 

students 1 basic skills. ^3" 2 1 ,Y N 

\ " " 

e. Interpreting the results of • 

\ . oready-made standardized tests ; # 

] to assess studenf needs in • 4 * * 

•4 basic skills. ' • 3 2 .1 Y • ^ N." 

*f. Interpreting the results of / 

tfeacher-made tests to assess • • 

* students 1 * needs in basic - * f 

' skill's. / ' 3 2 * 1- . Y N 

g. Finding and using. materials « 

and methods to help voca- • , ^ * 

tional" students improve * 9 ' 

their basic skills. - '3 2 , 1 Y ' N 



Can motivate 
^and assist 



Tasks 



To 

Very Q some 
veil degree 



.Planning prescriptive . teach- 
ing that will help stu- , 
dents l^arn the basic' 
skills the*y will need 

•on-the-job. • " . 3 

, *• 

•Determining how readable 
the textbook and other 
class materials ate in . 
vocational programs. 3 

Finding out what levels ' 
of basic skills are needed 
for jobs in varidus areas,. 3 

Teaching basic skills as' an 
integral part o£, voca- . 
tional education .programs. 3 

Motivating student inters 
est in learning basic 
skills through vocational 
education. 3 



Not 

at 

all 



Tried to do, this 
dujring the 
field test 



YES 



f 

Y 



Y '. 



Y . 



NO 



N 



N 



N 



N 



N 



* : 



" at 



* ■ ' ♦ 
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When the field teat began, you were also asked to agre& or disagree 
with a number of opinions abput teaching basic skills in vocational 
education programs. 

* 

How do' you .feel atfout these opinions now , after using the guidebooks 
yoiftself and working with teachers to use them in their classes? , ' 

m • v 1 s 

'The sam4 positive and negative opinions, yoi^ saw at the beginning of 
the field test are listed below. Circle one response for each state- 
ment to show how much you agree or disagree with it. Remember that 
your responses are7*confidential. 



Stat 



' S 5F 



ongly 
ree 



-Agree 



Disagree 



Q 
J. 



Combining vocational education vith baalc skills 
could help- motivate students to learn basic skills 0 

Vocational education teachers can't be expected 
Co correct In 2 years what students hsve &ot been 
taught previously by other teachers. . 

Vocational education teachers have a responsibility 
Co make sure their graduating students 'nave the 
reading, mathematics, and language skills they 
•need to get an entry-level job In their area of 

study. 

Trying.. Co teach basic skills In vocational f>rdgrams 
vlll take too much time away from teaching ^job- 
related content. . , 

Most vocational teachers already do teacrf the 
basic skills that their students need to learn 
class lessons. * 

Vocational education teachers should not h^ve 
to become remedial* reading or remedial mathe- 
matics^ teajchers. * 

* Vocational educators should worfc with basic 
skills teachers but vocational educators should 
not teach baalc skills themselves. 

\ • . 

Most vocational educators would welcome the 
chance Co get some help in teaching reading, ■ * 
mathematics , or .language skills to their " » 
students who need it. * , 

Most-vocational education teachers simply .are 

nor prepared for teaching baalc skills as part 

of their classes.' , < ' * > 

o 

Combining basic skills* instruction with vocational 
programs will give students confidence in "their 
abilities. 

» t 
Teaching basic skills along. with job content puts 
an unreasonable burden on the vocational, teacher. * 
* • " 

Teaching vocational students -basic .skills will 
help to make them more -employable. 

Vocational teachers should teach only those basic 
' skills directly related to their technical areas. 

i Vocational education teachers usually Know* which _ - 
students r ne*d help, .1ft- baalc skills withoutsu*ing7 , '' - 
tests^ln.mathematics or English/ ■ 



'4 



'There are almost nogresources available to^help 
,the vocational teacher combine basic skills, 
instruction with regular course work. 



*SA 
SA 

SA 
SA 
SA 
SA 
SA , 

SA 

K 

SA 

> -i 

SA 

SAv 

0'' 

SA 
v 

r 



\ V 



A 



Strongly 
disagree 

SD 



SD 



\ D 



SD 



3 SO 



<SD 



SO * 



SD 



SD 
SO 



- A 



SD 



SD, 



>S0 



SD 



SD' 



SD 
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Part 2 - Procluct-Ev«luation Scale * 
.Secfcioiy Av Rating the Introductory .GulSe 



« 



Below are^ a number of statements about the Introductory Gui de, 
Indicate whether yoft agree or iiisagrefe with each statement, of if you have, 
no opinion. Circle «one response* for each statement at the right. (Con- m 
/ . sldex only** the Introductory Guidef . You iri.ll rate the' Teacher Guides and 
the Resource Guides in the next two sections.) - > 

. * \ ' 

Don f t know 

• * • : Agree ^ Dxsyree No oplnlon 

. • ' * v ' ■ , ' 

1. ' The Introductory Gufte is essential^ for ^ . 

understanding and' using the other guides. / A D ? 

2. All the information in the {pjide was' ' " > 
> correct.,..* a A . D„ ? 

3. The guide included all relevant informa- 
tion that it 4 should have A D ? 

A. .The guide. was direct and teethe-point. % . . . A . D * ?fc 

, 5. T^a guide was easy to re| d i A D ? , 

• * ' • * 

6. The guide had no hard-tbrunderstand 

\ ' jargon..:... .i.*. A D- \ I 

: < . / . • 

7. Thefrguide gave practical* advice. v AD ? 

. ' ' • *■ 

-8, The guide addressed current issues in * k 

helping students with basic skilly A D • , ? . 

* . 

9. The guide helped in building a team to 
• - plan instructional activities.../ A 4)^ - ? 

10., The graphics and diagrams in the guide * * 

* helped me bp understand the guide ^ D ? 



1 



A 



s 11* The examples given -in ttfe guide were 
* % realistic* and helped me to understand 

the content .' ...... A D r - ? * 

12. The guide gives adequate guidance to v 

x . administrators in managing the people, . 4 . ^ 

time, and resources for basic skills J i - " 

instruction^. * , *• A D * * • 

* v „ - * 

13. The guide should tifelp to motivate **' . , „ 

^ /> o ^ teadhers and administrators to teach 0 ' . ' * 

basic, skills in vocational education s v . «. * ^ 

* classes \. 1 A , D " ' ? 
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\ N Don't know 

" . v Agree Disagree No opinion 

14* The guide, has an attractive format A D " ? 

15. T]he guide was*, clearly written. . <A D , ?* 

Haw much did the Introductory Guide ' help you do each of the following? 

Circle your, response at the right. ' ■ 

• . ' • * ^ £ , 1 Some r Not 

% A lot what much * 

16. Recognize the importance of teaching basic 
skills through Vocational education 

9 , 3 2 • 1 > 

programs ? 

* i, • . * 

17. Understand what vocational teachers can do. 

to teach basic skills in their programs? 3 2 1 

18'. Understand how to use* the Teacher Guides? ,3 ■ - 2 1. 

1 * . 

19. Understand how to use the Resource, Guides? .. .• 3 2 1 

20. Realize the , advantages and limitations of the 

Teacher and Resource Guides? 3 2 1 

21* Understand how the other guides are organized? 3*2 1 

22/ Be convinced that .teachers could teach basic 

skills in vocational programs? ........ * 3 ^' 2 1 

. v » 

23. Help teachers plan basic ^kills instruction 

. . v ' for a particular vocational speciality? 3 2 1 

24. Understand the content of the Resource and 

. • Teacher Guides? 3 \ 1 

v 

-How useful were each of the following chapters ;in fhe- Introductory Guide? 
Circle your response at the right. ** 

Very Somewhat Not 
useful useful useful 

v 

25.. Section I. Why Basic Skill development 

Through Vocational Education?.. 3 2 1^ 

26. Section II. Giving Teachers and Stents 

^ .-/Power t v 3 2 1 ' 

21. Section III. Using the Guides 6,2 1 

28. If you had the job of revising' the' Introductory Guide so as to make it 
, . more useful to administrators,, wjiat. would- you do? 



V 
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Section B - Rating the Teacher Guides ! 

~" ~r~~ * \ 

Listed below are the CitiUTs of the four Teacher Guides % * Which ones r 
did you read or use or bQth^"uircle your answer at the right. 

Read and Read it but . Neither read 
, f - ' tised it didn*t use it * nor used it 

1. Developing Reading Skills > x 

Through Vocational Education. ... 3 2 -1 

'2: Ueveloping Mathematics ^Skills * 

~Throug"h Vocational Education./.. 3 "2 1 

. '* - \ 

3. Developing Writing Skills * .1 
Through Vocational Education. . . . 3 2 1 

4. * Developing Listening and Speaking " f 

Through Vocational .Education. . * x 3 s ^ 2 1 

r 

Listed below are a number, of statements about £Ke> Teacher Guides . - 
An abbreviated "title for each 'guide is git the right. Under the title q£ 
eacf* guide which you read or used , write in whgthetf you agree or disagree 
with that statement for that particular gufide. Use these symbols: ^ 

A ■ I agree .with £his statement" 

D - I disagree with this statement \^ . 

? = Don't know or no opinion 

Remember, write in one of the three symbols for .each statement but rate 

only t^ie* guides you-actually read or" used^iii 'planning basic skills ♦ 

instruction in your classes. 

^Mathe-*" Listening 
* ~ - Reading matics Writing & Speaking 

5-. This ,guide helped me understand 

the content of this basic skill....... # - 

6. This guid<T\elpedi me tb understand \ 
how thi^bas\j»<slaLll is related 

to vocational areas *. . . . ^ 

7. This guide gave teachers good • ' 
.advice on lesson planning for 

teaching basic skills in their . ' 

classes , , > • 

-8. This gui^de gave good -advice on * 
adapting, lesson plans to include v . 
"basic skills instruction., J t J _ * Z — 

9. This guide showed me how to cope 
with factor 4' that affect tlie devel- 
opment of basic skills in students. V. / 

— v — . 

* t 
.^/page 6 " > n= -- 
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' Mathe- Listening 



Reading maticsvWriting & Speaking , 



10. This guide gave good advice on . 
• ^selecting v the 'basic skills related 
to vocational specialities 



11. - This guide helped .teachers specify • ■ # 

objectives- for basic skills ■ » 
lessons * «. * • • ' < - — 

' - ' ' / 

12. >This guide helped teachers select . • b 
dr develop instructional strategies, 

for teaching basic skills _j _ 



4 



13. This guide helped me locate or 
create testa and instructional 
-materials inuts particular basic v 
*. skill , 1 — 



...a.. ...... 9 



14. The content of this guide was 
accurate 

15. The Content of this guidfc was ^ . 

clear to me 1 1 : ^ 

• * 

16. All necessary content was included • s 

. • in this guide.. 1 ..;. r_ * 

- 17'. The guide was easy to read ^ 1 _ 

18; The** guide generally gave practical 
advice for instructional. planning 
.•'.for teaching basic skills * J 

19. This 'guide meets the objectives 

that it stated 1 . L. 

\ '20. Jhis guide's objectives were cleat.. * ,„ « • 

21. The illustrations in this guide 

help make the crfntent clear t . . . j 

22. This' guide can be used for planning 
basic skills instruction • 

i 

" a. in most schools 1 , - : 

♦ 

* b. at different grade levels ' «.l ; * — 

*. 

c. in different vocational areas* 



a. by teachers wi,th different 
training and experience 



4 
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~ . Mathe- * * Listening 

^ > Reading matlcs Writing & jSpeaking 

This guide requires in-service , * ; . \" 

training for teachers and adminis-' . 

tratorS'* to use it successfully,. .\ . . I , 

, * • * * > 
This guide is directly • related to , . * " 

needs and demands of teachers and ' ■ 

admits tratofs. . . % . /. . . . . # • • • • » • ^ ^ _j ^ : ' * 

s * » ■ » 

This guide is very * valuable for ' . 

teachers and- administrators *. . ' * % % 

Thi^ guide. shows no evidence of ^ . 
bfas with regard -to sex, race, or* • V 
socioeconomic' "stSfctis- of students.... 

f * .ft 

- * r , 
This guide should be equally usable 
Jby teachers an<} administrators of, \ 

"differing education and background.. « ' « ' > 

This *guide gives adequate guidance 

for planning >asic skills 'instruc- . 
tion for , , 

'* * * 

handicapped 1 students. . , - _ 

gifted students . • J ' ? 1 

othe,r students .with special needs. _1_ \ m 

s 

This guide is potentially useful for f . 

* planning basic skills instruction \ 

: io% adult education classes *. ' * ^ 

It was easy to integrate the pro- i 

cedures suggested *lfr£his guide with- /' • 

other school curriculum and testing . , • 

programs ^ . ♦ t v . . . . . c 

, / ♦ 

About how many, hours per weerk did you Use each of these in making/ t 

* instrudtional % pl^ns? How^many. hours of classroom instruction did this 
effect? ^Wirite in your best^stimate Qf average hours at the right. 

* . Hours Ofsed * Classroom 

in planning hours 
t - instruction affected 

* * * *■ 

a. /Developing Reading Skills r . ( \ 

• * 

* b. Developing Mathematics' Skills. .. . • \ • ! — • 

c. Developing Writing Skills • , 

"d. Developing ^Listening and Speaking 

Skills • - .. , 

* ♦ * » * 

* . 

* TDA/paee ff > , • 



32. -If you had * the job of revising these guides so as to. make them more. 
\ useful to, administrators, what would you do? Make 'separate 
\ suggestions for each guide. * • * * 

a. Developing Reading Skills Through Vocational Education . 



b. Developing Mathematics Skills Through Vocational Education . 



c. Developing Writing Skills Through Vocational Education . 



d'. Developing Listening and Speaktng^Skjlls^Through Vocational- Education. 



c 




■ # 
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Section C - Rating the Resource Guides , 

Listed below are the titles of (the 12 Resource Guides . Which ones 
did you read or use or both? Circl^vyour answer at the right. 

. \ . \ • Read' ancl Read it but Neither read 

' . . * i . -4 used' it? < didn't usa it nor used it * 

- ** * I. . Basic' Skill Domains and Voca- i 4^ 

tional Education Are£s: * / p ' 

Creating Skill/ D.O.T. Job title * 
*' ' Matrices ...\.. 3 + 2- 1.. ,* 

- - _ . ■ o- • 

c * • ^I»:>.>Iixs true tional Materials for* " f 

\" Teaching Particular Skills. * 3? *2 1* . 

# • 

IPI. Teaching Particular Skills for 

Particular Jobs 3 2 1 

IV. Tfesting and Basic Skill Develop- 
♦ ' ment Through Vocational Education; 
V • -References .\«. • • I 

V. Determining the Reading L^vel X>f .,5,.-* 

Vocational Educatidh Texts ^ ^ 

VI., Teacher- Made Tests>.and Other ' - 
Informal Diagnostic Procedures > 4 
Used in Vocational Education. . 3 - ■ - 2 *1 

* v£l. Basic Skill Development Procedures - • \ ^ 
• - ' for , Special Needs Students in ^ 

Vocational Education Settings T ^ - 2 * 1 

VIII.. Technipal Vocabularies % . 3 : '2 . # v 1 

IX* Minimum Graduation Requirements:, \ ' * ^ 

A Comparative Nummary. \ • % 3 2* < . 1 t 

X. # Building Support for Testing and • t _ : * ^ ' # / 

Teaching Basic Skills within • 

Vocational Education Contexts .. . 3. L 2 # 1 

; XI; .Resourceis. fbt Remediation of Basic - * * ' 

Skills within Vocational ^Education « ( • * \ 

Centers >. t 3 • . 2 1 . j 

XII : Resources fox the Reinforcement of 
^ Basic Skills and the Accommodation * 

of Students with Basic Skill ' ' ' ' - • 

Def icits in Vocational "Education " ' ' - ~ ^ . 

Settings. .. .T ...» - 3 2*1" 

* . ' * ' * . 

' -\- • ' * • ' 
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COMPLETE ONE COPY OF THIS PAGE" FOR EACH RESOURCE GUIDE YOl> READ* OR USED. 

Circle the number of the Resource Guide. you are rating iri the questions 
below. Refer to>£he list in the beginning of this section for the- titles 
t'hat correspond to. the numberals below. 



II .-'III 



IV V , VI ' Vll VIII IX X' XI XII 



* For the one, guide you have circled above > answer the following ques^ 

tions by circling your response at the right.' 

• - ^ Dis- Don't know 

Agree agree No opinion 



D 




a. Tho. purpose and objectives of this guide 

were clear to me • 

* • * * 

b. ^?*fhe content of the guide was easy to read and 

unders tand ; 

«. * 

c. The content of the guide was easy to read and 
understand * • 0 

* • 

d. This guide can be; useful in helping teachers 
m and administrators to plan basi? skills instruc- 
tion in vocational programs 

e. The content of this guide was accurate and 

complete "* 

* 

f. I feel I ^gained new knowledge from this guide. •» 

g. . - The information or procedures described in this 
guide could be integrated with current school** 
practices in my school or district./ A D 

' * ■ \ ' / I 

I^feel that I would need in-service* training 
to mak<^effec£ive use of this guide A D 

Describe briefly exactly how you utfed this guide in planning or 
conducting basic skills instruction in ^cur classes. If you are an< 
administrator, 'explain how it helped yqu plan and lead such 
instruction.. , «. 



A 
A 



D 
D 





, a . 












* 
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If you had the job'of revising this guide, so as to make it more useful 
to administrators, what would you do? Write your suggestions^on the 
lines below. 



FIELD TEST » , 

BASIC SKILLS THROUGH VOCATIONAL EDUCATION 



j 9 



ADMIJ&I STRAIOR INTERVIEW. 



This interview is'to N be conducted by the Field^Test Coordinator at a 
time and place coa^nient to the person. being interviewed. 

At the top of each page *is a major 'question. Repeat this Question 
aloud to the person being interviewed. Beneath each question are several 
probes, intended to show the direction and contieut of this line of questioning,. 
Use ^hese as the basis for furtLjr questions to get N -the interviewee to 
expand on his/her answer and to|give more detail.. In all the questions, . 
seek specific details and examples 

Room has been left cm each page for you to record the person^s/ 
responses coring the. interview. * These written notes should be typed after 
the interview for. future reference. 



Person being interviewed^ 



Person conducting interview_ 



V" / Site code -number ; Date this form completed 



1. Which jguides are you inost familiar with? Why these? 
Probe for: *■ 

• » » 

-a. '/Titles of guides actually used in planning and conducting 
classroom instruction. 

• .«« 

b. 'Titles of guides which person x read or is otherwise familiar with. 

c. Reasons 'why other, guides were not used or' read. 



112 



. .114 



to read? 



2. thx the whole, were the ^materials clear and easy 
Probe for:- 

A * • 

a. Clarity o£ ctoj actives. 

b. Clarity of content* 

c. How sequence and illustrations ^£ect clarity. 

d. Differences among guides* with respect to^clarity. 

e. * Which portions. wer£ the clearest. > 



r 




L 

3* Was the content adequate and accurate? (Note to interviewer-: "Content" 
* Here means. the facts, procedures, methods, research, etc/ pre§ented, *as 
contrasted with the style" and organization dealt with in the' previous 
question.) 1 ' ' 1 

Probe for: • - 

a. 4 Completeness of content. ' <' * 

b. Relevance of content for intended outcomes. 

c. Content that is present but not needed. . 

d. N^ed.for administrator-oriented content. ' % # 



4. Consider far a morient only those guides you saw teachers use (or try 
to use) in planning or conducting instructing • How did they use them? 

Probe for: <- , 
♦ » * * 

a. * Outcomes *being tried for* 4 

b. Actual experiences and examples. , , 

c'. Differences' In using guides with varying classes, students, or 
courses. 

% f d. How instructional or administrative practices changed. 



5 ~ What problems did yoa encounter in using thfe guides? What problems 
do you think others might Encounter? 

Probe- for :- t s • * 

. ;a'.' Specific tasks which need clarification; adequacy of administrative 
♦ • guidance throughout guides* . ' & 

' b. Difficulties in integrating tes't and other procedures outlined in 
. the'guides witft othet school curriculum and -testing programs, 

c\ Need for experience, education, or in-service training for effective 
use of materials;^ 

. - / d** Influence of pupil characteristics on effective use. 



6.* Did you find these materials; to be. practical to use? Do they work? 
Do you think others will also find them to be practical?' ^And why? , 

Probe for: • - . :* - 

V 'J «• * 

a. Time, 'money, and other 'resource** which were needed to use guides. 

What, resources were needed* but noj: available. 
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*. 7» • Did you find any examples of bias .agSinst teachers ot j^tutfents *due to 
sexismy racism, or other forms of , *|^^i^ti^^materiars? 




V 
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8,, Do yotr feel that these materials give teachers ^and. administrators' 

adequate guidance for planning ^nd conducting basic skills instruction 
^ for special neecls students 9 \ for example, handicapped, slow learners, 
etc.^ Can these materials potentially be used to incorporate instruction 
in adtxlt education classes? 9% , 



\ 
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9, ^ What do you think would be a 'reasonable sales pr^ce for the materials? 

* 

Probe for: 4 ' - 

a. The price if school^ fu^ds were being spent* 

b, 4 The price if the interviewee vere.' spending personal funds. 



V 
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10. Overall, in s.unmiary, what impact do you think these guides could hjtve 
on vocational education? Do you think they are valuable?' 

, i> * , 

, Probe fore * 

* a. Relation of materials to significant needs an* demands 6f 
education personnels ... 

b. Perceptions of. possible effects on peaching practice. 



r 
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FIELD TEST • 
BASIC SKILLS THROUGH VOCATIONAL EDUCATION 
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1 GUIDELINES FOR COMMENTS 



Reviewer Version 




•V 



t In thi£ field test of 'the Resource^and Teachep Guides, the product 
developers are seeking information which wiA help them revise and im- 
prove the guides. r 



/; 



An important- source- of such information is your written comments :} 
:on the pages of the "ffiatpriate. .The reactions of reviewers, such as 'your;- 
self, with 'expertise d.n basic skills ^vocational education^or product | . 
T> development are* essential t)> the' development process . • .Consider not on] 
your own v,iews, however, b\re^4iso how .you think teachers and adnrinist&£- 
tors would r^act to the materials. - ' • 



* * ' 




^ WHSn you cqme to a place in the guides -that needs improvement 9 '>m 
x> .pleas^qircle^,pr mark it^boldly,* an* make . some commerit about, it, * Ybu * . 
dan make several kinds- of comments. You could v *simply state that a/par- 
J? ^ticulax^hlag is good or bad\ . Or you could go furthet and write aft 

short expl^sti<>;n about the \pause of a problem • in t;he te*t-. dr yljf could 
r jgo iV furthgr still; and* make suggestions for improvement. M 

aa * t ' To ^atever^extent\you cany please try^o include suggestions for 



improving the ^content * Remember, howffifrer \ that al^ responses axe appre- 
coated.- ,.* ., ■ v'. • '! rf 4 ': 1 



In addition, we. ask that you BE BRUTAL. We belieye £hat ./'criticise} 



will br&ed* a better* product. ♦ 



ft 
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J. * • . 

When you have finished making your written comments, return the 
guides according to the instructions you have, been given. If you wish, 
you may* have a clean copy to replace it. 



. On the next page are same suggestions for comments. Dort't feel 
» limited by these, • You may write any comments you want. 
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Suggestions for Comments 



CONTENT 



Is the content, accurate? 

Is the content up-to-date? / d # - 

Is the content appropriate for the needs of teachers and administrators? 
Does the content include all relevant information an4 exclude all 
irrelevant' information? *■ , 

Is all relevant information adequately cov^ed? - 



CLARITY 



Are the objectives of the guides clear? " 
Is the writing clear and understandable, to you? 
Does the s&quence of tppics/help' make things clear? 
Do the examples and illustrations contribute' tt> the clarity of the 
guides? 



ORGANIZATION 



Does the organization of the guides help you to understand them? 
.^Would^the organization be helpful to teachers and administrators? 
<y *l* Is there another way of organizing the booklets or topics that 'would 



make them* easier to understand or to u$e? 

APPEARANCE ' « 

Are the guides attractive to read and to\use? 



Are there any typing or grammatical errors? 

Do .the type style and page' layout makeths guides easy to read? 



PRACTICALITY 

' .* ' ' . . * . '• 

What tasks suggested in the guides are not practical for teaching 
. . and administration in most schools? In most ^districts? In 
" most states? 



c 



VALUE 



What parts would be most valuable to teachers or administrators in 

' planning or administering instruction? 
Which parts are not valuable or useful? 



FAIRNESS 



/- ■ 



Is there any T^ias or discrimination in the guides- with respect to 

sex* race, socio-economic status, handicap, or other character- 
istics? . 



SPECIAL NEEDS 



Do the guides give adequate, guidance on planning or administering 
basic skills instruction for groups with special needs such as 
the handicapped or f slow learners? * 



PIELH TEST 



BASIC' SKILLS THROUGH VOCATIONAL EDUCATION- 



PROPUCT EVALUATION SCALE 
Reviewer Version -. 



The Product Evaluation Scale asks for your ratings of the Introfluctary , 

Guide d the^ Teacher ^Guides , a!nd the Resource Guides . 

/ 

There is one section ^or'each type of guide. Make your responses 
according to the, instructions given for each sectioji. * 



m 



Your name 



Date this 'document completed 



'%■ 



? f - * 



w 
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SIS 



Below ate a numl^r of statements aboat the Introductory Guide . 
Indicate whether you. agree or disagree with each statement, or if you 
have no opinion, vCircle one response for each statement at the right. 
(Consider only the Introductory Guide, x You will rate Teacher Guides 
and tlte Resource Guides in the next two sections,) 



Agree Disagree ' No opinion 

• . *■ 

1. The Introductory Guide, is essential for 

understanding and using the other guides. . A D ? 

2. All the information in the guide was 

correct. \ . .* AD ? ^ 

r 

3. The guide included all relevant information 

that it should have A D # ? 

4. The guide was ,dire'ct and to-the-point "A D .-*•■? 

5. The guide was easy to read. AD ? 

6. The guide had no hard-to-understand jargon.. A DX ? 

7. The guide gave practical advice A -D 7 ? 



* * 



8. The guide addressed current issues in* • . 
helping students with basic skills' i. .A * D ? 

' / 

9. The guide will- help teachers and administray 
tors to buiid^a team to plan instructional 

activities * A D ? 

10. The* graphics and diagrams in the guide 

helped me to understand the guide ""A D ?. ' 

11. The examples given -in the guidj* were f 
realistic and! helped me to understand the • 

content ......... A • D ? 

12. The guide gives adequate guidance to # ■ 
^administrators in managing the people,, time, 

and resources for basic skills instruction. .A D * ? 

• ': <& 

13. The guide should help to motivate teachers 

and administrators to teach basic skills ■ i ' ' 

\ in vocational education classes. A, ti\ ? 

• ' - \- A. r ■ 

14. The guide v has an attractive -format A D ? 

IB*,/ The 'guide was clearly written^. ".' . A D ' ? ■ 

. • • •* • * c» • ■. 

>3«~.A, - > 1 ..->■• ■ " ? 
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How much will the In troduc tory \G\xid e help teachers and administrators do & 
each of the 'following? Circle your response at the right. 



. How much will Introductory Guide help users'. . 

^ " \ ~" ' S ome- No t 

A lo t what Much 

16. Recognize the importance of teaching 'basic skills * * 

through vocational* education courses? 3 2 1 



17. * Understand wh^t- vocational teachers can do to 

teach basic skills in their courses? . ; 3. * 2 / 1 

18. Understand how to use the Teacher Guides? 3 2 ' 1 

19. "Understand how to use the Resource < Guides? 3 2^* 1 

20. Realize the advantages and limitations of the * \ * 
Teacher and Resource Guides? : .* 3' 2 .1 

21. Understand hoy the other guides are organized? 3 ** 2 1 

22. Have confidence tttat they can teach* basic skills 

in vocational courses? \ 3*2 1 

23. Plan basic skills instruction for their particular 

Rational speciality? ■ 3 2 1 

24. Understand the content of the Resource and Teacher ^ , * 
Guides? ...... \... v*..'. 3 2 1 

How useful will each of the following chapters in the Introductory Guide 
be to teachers and administrators? Circle your response at the right. 

Vexfy Somewha t No t 

useful useful N useful 

25. Section I. Why Basic Skill Development Through 

Vocational Education?.... 3 2 1 

\ * > 

26. Section II. Giving Teachers and Students Power.. 3 2 1 ' 

27 . Section III . ■ Ustng the Guid'es ...... . 3 2 1 



28. If .you had the job of revising the Introductory Guide so as to taake it 
more useful, attractive, or easy to read, what would you do? 



V. 



— -t —T 
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Section B - Rating the Teacher Guides . 

Listed below are the titles of four Teacher .Guides . Which ones did 
you* review? Circle your answer at the right. ' • 

4 " , Reviewed Did' not 

* '* ' it Review it 

1. Developing Reading Skills Through ' > 

VQcational Education * • 2 1 - 

• • • * - ,* 

* 

2: Developing Mathematics Skills Through . # 

Vocational Education 2 # -1 

3. .Developing Writing Skills" Through ^ * 
Vocational Education # 2 

4. Developing Listening and Speaking Through, 

Vocational Education < 2 1 

Listed below are a number of statements about the Teacher Guides . An 
abbreviated title for each guide is at the right. Under the -title of each - 
guide which you reviewed ~ w*ite in whether you agree or disagree with that 
statement for that particular guide. Use these symbols: 

A - I agree with tftis-statement 
' " s D s I disagree with this statement 

. ? = -Don't knbw or no opinion 

N ' \ 

Remember,. write in one of the three symbols for each statement but £&te 
only the guides you actually reviewed. 

: — . MatWe- Listening m 

- Reading maticg Writing ' & Speaking , 

5. this gdide will help teachers under- - 
*V stand the content of this basic 

skin... i — — — 

6 r This guide will, help' 'teachers to * 
understand how this' basic skill. is # , ^ 

related to their vocational * • . ♦ 

•specialty/..; • v ' 

t * * 

7. This guide gives gooci advice, on — v 
lesson planning for teaching basic ^ t 
. skills in vocational classes ' * — ; — r- - 

8* This guide gives good advice *on 

adapting lesgon, plans to include. V- V 

basic skills instruction^; L_ " _j • 

• * 

* *• « ** 
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^ Mathe-tf Listening 
Reading' matics Writing ' & Speaking " N 



9. This guide shows how to cope with 
' , factors that affect the development,, 
of basic skills in students 

l&l This guide gives good advice on 

selecting the basic skills related to 
vocational specialty -» 

11. This 'guide will help teachers 
specify objectives for basic skills 
lessons : . . •* 

12. This guide will* help teachers select v 
or develop instructional strategies 
for teaching basic skills' * 

13. This "guide will«help users locate or 
create tests and instructional • ' ? 
materials in its particular basic 

skiii : 

14. The content of this guide was ■ 
accurate. >• • • 

15. The content of this guide was clear 
to me , 

\L6.^_/A11 necessary content was included 

in this guide.. ; 

17. The guide was easy to read/ 

18*. The guide' generally ga^e practical . * 
advice fo'r instructional planning 
for teaching basic 1 skills 

«■ * 

19. This guide* meets the objectives that 

. • it stated. A s ...... 

20. . This guide's ^objectives were clear.... 

-21. The illustrations in. this guide help 
make* the content clear'; • . ♦ 

22. This 'guidei can be used for planning 
basic skills instruction 

3. in most schools...../.../ 

b. at different -gra^e .levels^. .... 

c. in- different vocational afea%1 . . . 

: -d%i by teachers with different train- 
* • ' \in% and experiences . . • 

*; . J A . J, ■; . . . , , ' ' EER/page 4 , 
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. needs and dean^da of '■-teadL^-- _ 

^ 25\ ddPgiiide is ve^yfcluable. -fpr • - * ' \. ' . • 
• * teachers and' administrators,. .-.L... . ..- .. , . -- ^ * 1/ 

. 26. This guide shows iu>:e#ide^^ . /- § -V 

' 'with regard to £ex* race/ ot .socio- V * . ' * 

^economic status of students! ; . ... ' ? ; , 1 - * / " ^ 

• • > . - , . • • ' •'. \ • 

% 27. This gilide should he equally usable 

by^teachers of differing education \ - ^ / 

and background J .-. . . ^ * . J. ^ •> L. 

m 2S. This guide gives adequate guidance for 

planning basic skills instruction- for - • - 11 

- c <r . ' ^ ■ ■ . ^ 

handicapped students. .. . ' - ^' p - 

*gifited students ; " 3* 1 

other students with special needs..'. _ 1 * 

, 2'9. This .guide is potentially useful for ■ 
* f planninjg basic skills instruction * > - • * 

'for adult' education classes. . ' 

\ 30. It 1 will be easy £0 integrate the " ^ % ' 1 

procedures suggested in this guide * * » < * 

with other school curricdliini and x ■ 

testing,«prograni$/in most schools { . - - ^ > „ 

' ' « > ^ " " — " 

; fc - . ^ . f • , • • ^ 

■ ^ . . ' ' v ' ■ 

***** ■ ' 

• ' ' ; . • •.. . • ...i3r : ' w 4 • - 
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31/ If you had the job of revising these guides so as to make them more, 
useful, attractive^ or easy to read, / what would you do? Make sep^kte 
: -suggestions for each "guide. 19 M 



-^ fe. developing Reading' Skills Through Vocational Education * 



b. Developing Mathematics Skills Through Vocational Education. 



c. * Developing Writing Skills Through Vocational Education , 



d. Developing Listening and Speaking Skills ^Through Vocational Education . 



* * * • 



— pr- 



ifERjc ; ■ v 
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Section^ - Rating the Resource Guides 

- ■ : ; r 

Listed below are the titles *of the 12 Resource Gui d> 
did you review? Circle your "answer at the right* 

* Reviewed 

. . • • • • it ; . 

* * — v 

\ I. Basic Skill Domains, and Vocational ' 
' Education. Areas: \ Creating Skill/ , 
„ . D.O.T . Job Title Matrixes;. .' 2 

II". Instructional Materials for Teaching 
4 Particular Skills. ....... 2 

' .HI. Teaching Particular Skills forParticu- • 

lar Jobs 2 

IV. Testing and Basic Skill Development 
^ JThrough Vocational Education: 

j References • 2 

« 

V. Determining the Reading Level of 

Vocational Education- Texts. .. '. 2 

VI* Teacher-Made Test^ aftd Other Informal 

Diagnostic Procedures- Used in Vocational 
Education 2 

VII. B^sic Skill Development Procedures for 
Special Needs Students in Vocational 
Education Settings •• 2 

. VIII. Technical Vocabularies 2 

IX. Minimum Graduation Requirements: A 
^ J ^Comparative Summary. ... v . .... . 2, 

- * Y. Building Support for Testing and Teaching 
/ , * Basic Skills within Vocational Education 

1 « Contexts..... y>* • 2 

XI. Resources for Remediation of Basic Skills 

, , 'within^ Vocational Education Centers. ..... 2 

XII/ Resources for tfte Reinforcement of Basic 

\, • I Skills and] the Accommodation of Students 

4 . with Basic.Skill Deficits in Vocational 

5 , Education Setting^. . • • 2 

A * , - ' / v • ' 

r ■ ' " ' / \ . i • - . i 
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. Which 'ones 



Did not 
review it 



1. 
1 



1 
1 



• COMPLETE ONE COPY OF THIS PAGE FOR EACH RESOURCE GUIDE YOU REVIEWED. 

Circle the number of the Resource Guide you are rating in the questions 
below. Refer to the list in the beginning of this section for -the titles 
that correspond to^ the. numerals below. # » ' • , 

I II III IV V VI VII VIII IX X XI XII 

* * * • * 

• ' * For\the one guide you have circled , above, answer the following ques- 
tions by circling your response at the right. Di ' g _ 

Agtee agree opinion % 
• » 

a. The purposes and objectives r of this euide * 

• were clear to m^ A D 

b. % The content of this guide was -clear to me '«*.... A ■ ? 

ft • 

c* The content of the guide was easy to read an4 

understand I AD? 

d. This guide can be useful in helping teachers to 

plan basic skills instruction in vocational 
* ^ " programs v • ? • • • A * D ? 

t e. The content of this gutde^ was accurate and 

* complete A D . 

* * i"" 

f . Most tfseivs will gain new knowledge from this 

guide ;•• A D < ? 

g. The ii^ortiation br, procedures described in 

this guide could be integrated with current . ^ • 

school practices in most schools or districts... AD? 

9 t - 

h. Teachers would need in-service training to 

make effective use of this guide ' A D^ 

• * , . . 

i. If you had the job of revising this guide, so as to make it more useful, 
•attractive, or easy to read, what would you do? Write your suggestions. 

on the lines below. ■ . '* 
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FIELC test 

BASIC SKILLS THROUGH VOCATIONAL EDUCATION 



REVIEWER INTERVIEW 



^ This interview is to be conducted by the Field (Test Coordinatqr/at a time 
and place convenient to the person being 'interviewed. 

At- the top of each page* is a major quest ion^. Repeat "this question, 
aloud to the person being interviewed. Beneath ea'clT'question.are several , 
probes, intended to show the direction and content of this line of questioning. 
Use these as the bas^is for further questions to get the interviewee to 
expand on his/her answer and to give mora deft ail. Iti all ttie quj&Jstioris, 
seek specific details and examples. ' t m *% 



1 Room has been left on each page for "you to record the •person*' s 
responses during the interview. These written notes shpujd be typed after 
the interview for future ref erence* * 



Perso^j^ing interviewed^ 



Person conducting interyiew_ 
Site c^de number_ 



Date this form completed 



4 



V> " Kr 

><• - ■ • - 1 

' 1.. Which guides did you 'review? 
^ • > Probe %r: 



r * 



a. Titles -of guides' actually reviewed. • ^ 



\ • 



i 



r 



t: 1 * 



2. On the. whole, were the materials clear and easy to read, for you? Do 
you. think they would be ^equally . clear for most vocational education 
teachers? ^ 

Probe 4 for:. . • \ i"* > 

a* .♦Clarity of objectives . 0 ♦ " 

^b. c'&laritx of * cqntent i f « . ^ . # 

c. How sequence and^illustrations affect clarity ^ , 

♦ " , d» Differences among guides with respect to clarity 

* * »e». Which portions were the clearest* • \^ ; 



" 4 



\ 



i' W * 'J' * 



141 



3. Was 'the content adequate and accurate?, (Note to interviewer: "Content" 
here means the facts, procedures, methods, research, etc. ' presented, as 
^ contrasted 'with the style and organization dealt with in the previous 
(question.). 

Probe for: , . 

a. Completeness of content 

b. Relevance of content for intended outcomes 

c* t Content that is present but not needed. » * ~ 



^# What difficulties do [you think teachers might r encounter in t using these' 
materials? 

T>robe for: < | 

a* Sptcificj' tasks which need clarification; adequacy of guidance 
tlproughtOjUt guides'*. y ' 

b. * Difficulites in integrating test and other procedures* outlined in 
th^jB guides with other school curriculum and testing programs? 

c. N^ed for experience, edijcation, or inrsei^ice training for effective 
use ofifnaterials^ * 



d. Influence of pupil characteristics on effective use. 



144 
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5. Do you think teachers and administrators will find these materials 
to be practical to use? 



<£rob6 for: 

a. m *£imst, money, and other resources which may be needed to use guides. ' 

b. What resources may be needed. but not available. * * 



• / 



145 



6.'. Did you find any examples of bias against teachers or students due to 
sexism, racism, or other ^forms o^bias in the materials? 



A 



" ;3 
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7. What differences .might there by in using the materials among sites, 
districts, anji states? 

Probe for: 

a. Possible effects of building, district, and state policies of 7 
laws on materials use* • 

b» Possible ^her effects of conditions on materials use and effects., 



\ 



Do you feel that these materials give teachers and administrators 
adequate guidance for planning and conducting basic skills instruction 
for special needs students, for example, handicapped/ slow learners, 
etc* Can these materials potentially, be used. to. incorporate instruction 
in adult education classes? ■ . 



9 



4 , 
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v 9. What do you think would'be a reasonable sales price for the materials? 
Probe for: 

'a* The prifce if school funds were being spent. , ******* 
The price if the intervievee were spending personal funds. 



• 9 



J 



* 



> *1 



« 



y 



3 
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10, Overall, in summary, what impact do you think thefee guides could have 
on vocational education? Do you think teachers will find them to > 
be valuable? 

P,robe for: 

a*,- Relation of materials, tojsign:fcficant needs and demands of 
education personnel. ■ 

b. Perceptions of possible effects on teaching practice. 
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FIELD TEST ~ 

i . 

BASIC SKILLS THEOUGH VOCATIONAL EDUCATION 



SITE SELECTION LOG 



This 'form' is to be completed, by Field Coordinators or other project 
staff. -It is .not to be shown to personnel at the .field test site. « 



Site name and location 



• 4* 
2 - * 



Site code, | Date this form completed' 

Person completing this form 



Is this a participating _site? Circle one. YES NO 
> £ * if * * * 




Part 1 - Site selectioa donfcacfcs * i * * V 

This form i§ des%n.ed to ^report three kinds of information: , (1) what the 
school district doe$, an<| is,/*as acted *but. by, and reported by, school district 
personnel, (2) whatx the Filldt Cdordinator, and CIOE^ staff do and perceiye,- and 
(3) the interaction that qcefcr$lkf#w§en the? school ^^isti«ict *staff and the s 
project staff . • • ' /, - 'Vfe? * -~ v< .><r"^' ' " ' • * 

• ^ ^ v * . ' r 

The^ primary focus of alj iriiormation *rtfcprded is the school^ district 
as represented by the different staff members of .thii^istrict^^School ' 
district" here can mean a regional vocational, or 9 bcpupational^ education 
center j as well. , ' r ^ 

J Part 1 records the succession of ccjntacts that' the Field Coordinator 
or other project staff. have with school district staff in^the course q£ k 
negotiating the, v district *s participation in the field r teafe. 



7 A "contact is Considered to be any interaction, by phone or face-to-face,* 
between a pfpject staff member and. school district personnel during which some 
problem or aspect, of the initial commitment t6 participate in the projectile 
♦worked on by both parties.. T q * " 

^ . \ ' • ' > ' ** • '\ v-f" 

^ Phone calls in which information is simply supplied, transMtted, or sought 

vAiXTtttj^ some record of it might, be. made and 

perhaps report ed^ar the end^of Part 1. " - — -y- 

4 \ The meetings should .be reported i^brder *by the date of the ^meeting, the 
fifst meeting £irst^ the last mating; JIast . * Write or type .in a brief one or two 
sentence account of the meeting, - including , who was there and 4 the purpose or 
activities of the meeting. Then list the putcqtoe of the meeting. % , 



Part 1 - Sitfefs election contacts (Continued). 

Contact # 1 Date ^ 

Activities : 




Outcomes: 



- Contact 2 
Activities: 



Date 



Outcomes : 



Contact # : 
Activities* 



Date 



Outcomes : 



Contact # V Hate 
Activities i • 



Outcomes: 



Contact^ 5 Pat e 
Activities: r> 



Outcomes : 

r t % '"V" ' ' ' /• - ^ 

If tltere werfe additional contacts, report! them on anothex ^shee ^ * * 
V'of paper, .following the . same irormat: as above. ' f m y c 

' - Alston, -another page, describe any pther conmnin^catio t ns, with district 
personnel or pther event^which may have influenced the selection process" at 
this; site, and which are* not reported above. Especially report events that - 
occurred between, the. ppntacts listed' above, such as a meeting betweeri : admirii-' 
aerators, personnel changes §".. and. so on. ^ * *. . , 

' ^ : ' - JSSL/'page 1 • ' * * ' 
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. 1 | 

Part 2 Staff participation , 1 

.Part 2 /describes the persons participating in the site .selection 
"process and tt(fe* degree of their involvement. \ \ 

First, list each person who participated in any site selection .meeting 
by name, position or title, and tHat person's scope of responsibilities.* 
At the right , rate eaqh person witlr respect to : 

.~ 1^— The^frouat -q f in f luenc e wfcich t hat, per s o n, had on^the^district' s . 

decision to participate ,(INF) 

2. The person's level of verbal* participation in the contacts,, 
and meetings (VP) 

3. The person's level of knowledge and expertise in vocational 
education or basid -skills instruction (KE) 

.For each of these three dimensions * use 'the following rating scale: 

5 = Very high 2 = Low t \ 

4 = High 1 - None 

3 = Moderate 



1. *- Nik ' ^ : - : • INF 

Title or position ; t ' VP 

Scope of* responsibilities / * , . KE 

2. Name * ; [ INF 

Title or position / VP 

Scope of responsibilities * \ KE 

3.. Name . ■ INF 

Title or position * ; VP 

Scope of' responsibilities * \ ; KE 

4. Name - , INF 

' Title or position \ ; " \ 'VP 

Scope o? responsibilities - . - ' ; \ ; ; KB 

5* Name - "jr + ; < • INF 

Title or position ± . , ' ■ ; ^ VP 

Scope of responsibilities ■ , ^ * , ' KE 

(If sore names are to be. included, continue on the back of this j>age, using the same format.) 

.: •". • > . '.>' - '"' V '. • ' \ 
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Part 3 - Materials characteristics :> 



4 * Listed below are some characteristics of the materials which may have 
influenced the'site's decision to participate or riot participate in the field 
test. Rate the ^degree of influence of each using the following scale: 

•4 » Decisive - ' - , v % 

3 * Very influential ' 
4 • 2 Moderately, influential O * 

1 * Minimally influential 
* . . 0 * None or not relevant to this site 

Then, indicate whether the characteristic had ^positive (+) or negative (-) 
influence on the site's decision^ to use the* materials % in the field test. 



u * Degree of Direction 

Mate rials characteristics # influence - Qfr or - 



1. Purpose of the materials _ 

2. Scope of the materials or their applicability. . 

3. Complexity of the tasks to be performed _ 

4. Skill's required to use' the materials. 

5. Financial cost to site* of using the materials 



6. Staff cost (time) needed to use the materials.. 

rfk. \ - ' * 

7. Time span of materials'* use t 

8. ' Organizing staff for using the 'materials. • 

9. Sequencing or relation of these materials to 

other materials being used* i , . ..<? : 

■> • 

10. Administrative and clerical costs of use. 

Provision of technical assistance from CIOE • 

* and from Field Coordinators 

12. Association with' CIOE or Cornell University.... L 

13. /The materials as an innovation....* ........ _^ 

• 1 > ■ * 5 ~ 

14.. The materials jds a device for extending role . ^ 

• responsibilities of teachers ' ♦ 

15. The materials as a method for teacher 

participation in curriculum decision-making. . ^ 

16. The materials as a staff training device. 
•» 
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Part 3>- Materials characteristics (Continued) 1 

m l Degree of Direction 4 

Materials characteristics * , - influence + or ^ v * C 

■ " ..... , ^ ^ 

17. The materials as a method for raising 

student performance in basic skills. 1 ^ 



18. Packaging, attractiveness of materials 

19. Other cHaracteristic? . Describte'and rate each, 

4 a. . - ■ . ; t: 

b. • ■ > ' 



c. 



Use the space 'below to expand or clarify any ratings you have made. 



i 



v- 



■39* 
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\ 

\ 

A - ' 

. V/ 



v 



* ' vl 

-* 



' Part School district, characteristics • - 

Listed below are some . school- district characteristics which may have 
influenced both the site's 'decision' to participate, and the project staff f s 
decision to include the site, in the,, field test. Rate the degree of influence 
of each -characteristic using the* following scale : * 

* 4 Decisive- , \> V • . > • ■ • j > 

* 3 « vjfery *4$f lueutial \ / ' . » * > : 
„ 2 f Moderately influential 

4 1 •« ifiniSally influential w 

(I * None or not, relevant to ttiis site \ . «* 

> J » . 9 

Also indicate if the characteristic had a p,ositiv^(+) or a negative (-0* 
influence on the ; decision of the site personnel, or the project staff 'to use 
'the materials at this site, Put the + or - in front of tfte number... 

*&t* ' " • ♦ -s. " » 

w Degree and direction 

' - ^ ; • t of influence on 

• District characteristics , , , Site - Project 

, ^.'. / . decision ^decision* 

1. School district official educational goals y 

_ and objectives.. »- ; . ^ y * ' 

\ , •* . • 

2. ^Schodl district priorities »: ...... - - c 

3. - District's financial resources * - ; - 

4. Nuinber.of teachers who could participate..*...'... _. ^_ 

« : • - \ • 

5. Staff expertise -±n basic skills ^ ... . . c < r . i 

* * * • * 

* . - ' . * i 

6. Staff expertise in vocational education , n 

' 7 . Staff work load.- .n . . . . 2 - — ' > • 

* . . . - * • 

. 8 . District 1 s interest in innoyat ive' programs:. ...... r . ' 

9. Size of School district .(number of students)...;;. ^ ,y . r 

10. s£'ze of vocational education program. . . 7 . " „ 

\ m ' " " ' * % ' ' * < ' ' ^ 
11 * Areas covered in^ocational education program.... :m "' v 

•• - "■'T~ r ~;- - 
12. School .district/leadership - superintendent* • ; , ' 

- \ . • . - . • ^ 

13*. Site leadership- - princip^. ' t I /••••** ■ v ' - 

14. District administration -s relations with. ^ . .\ ■ 

district staff. ••' *- - . 

v V _ ' * 

*' " • ■ , /SSL/page 5^ *. 
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P$rt 4 - School district characteristics (Continued) ^* 

< 

* * 
District characteristics 

15. School district relations with community 

' ^ * * 

16.. Vocational education teachers 1 relation with * 

other t'each£rsf£n same building or at home school... 

****** : " ' 

17. Amount, of .consensus among district staff about • 

use of materials. . . • . * . 

18. School district staff 1 s understanding of materials 
and how to use them 

19. School district staff's clarity with respect 

to their objectives for using the materials 

20. Priorities of state level administrators...*.: 

21. ^School district's, ability to provide r&ources for 
using materials . . % % 

22. Hidden objectives (specify) 



: Degree and direction 

of influence on 

• Site Project 

decision decision 
— : <r 













23. 


* 

* Personal factors .(specify) 














• > 


\ 




■ — 1 : T . 




# : ■ — 


> 


> 


Political factors (specify) 












* N < « 

* 


1 # 




25." 


Other factors (specify) 




> 

* 
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FIELD TEST 



BASIC SKILLS THROUGH VOCATIONAL EDUCATION 




Site name 



Site location 



County in which site isjpcated 

Site code • State 



* Person completing this form 
. Date this form completed ; 



co^i^t 



This form is tOibe co&pl^ted by the Fieldi Test Coordinator or other 
project staff during the materials usage stage of the field test. 
~*Some of the information may be gathered from administrators and teachers 

® * . ' o 

at the orientationt*session, however* 

" ^ • * - ■ 

Completepjrie copy of Part 1 - Site Description Scale for. the site. 
Compile one cqpy of Part°2 - Classroom Description Scale for each class 

which has a /teacher, participating in the rieldrtest. If one'teachej: has 

. ; " , ' 

three classes* during the day, then there will, be three Classroom* Descrip- 

tion Scales to describe that ,teacher*s classes. * 

Possible .source's of data include local teaphers and administrators,, 

district* research staff, census data, and the City and County Data .Book. 



* Part 1 - Site Description Scale - ? 

This, part of the package is intended to describe* the area whiclSfe 
"surrounds" the 'site , the context in which the site exists. Although the , 
items on. this scale are written with the assumption 1 that this area is 
the county in which the site is located, it may be 'more appropriate to use 
the "city" as the context for those s'ites. which are located in cities 
large enough to; have separate figures readily available (eig. , in the " 

* City and County Data Book) . Some items ask for separate informatipn for 
^the district' and the «ite within which that .district is located. For those 

items, the district figures should include the site figures wrthin them. 
If a site draws students from more than one district, comBine the figures 
for the sending districts. „ * ' ' . ^ 

1> Slzg -/•".' ■ ' ' • • • * District . " Site 

a. Average dSily attendance, 1974-75 sdhool year ..; h ' 

b. Average daily attendance, 1979-80 school year ... ^_ 

<■) _ 

c. Percent change in attendance, 1975-80 X.. j * ._, 

V \ ^ - ^ " ' . 

2. Sending schools % * 5 y 

' 

Does this site have students who also attend several other schools (some- 

* * ** 

• times 'called "home schools")? Check one-. YES NO^ 

If yes, then show on a^separate sheet of paper the r names of all the striding 

^ schools.. For each school, list the number of students at/ that school* and 

* ** * * 

the number of students, which the school sends to the vocational education 
site. ' 



4 * • £ ' ' ft 



vsr. 



\ 



\ 
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If EHJC '^v-.-^, 'W.^ N ,-" i6o- r , 



Persistence 



District 



Site 



"a, Percent^ of students Who drop-out before .graduating 

\' : 'h. ^Student turnover, rate in the 1,979-80 school year 

+ • 

4. * Composition ^ - - - 

Write in the number Sf students; not the percent, in" each category. 
Sex * 



Males 



District 



Site 



Females . 
Rate 
White. 



r 



' Black.* \ 

Othfer (specify) 
Race*and Sex 



White males. 



White females. 



Black frales .« ;. 

*~ •/ : " 

Black females . ...... ^ . 

Other males . . . !. '. . . . . 

'Other females v.... 

Primary lan^ua^e • 

English .1... ' f " 

f , Other than English . 

' ' \ ' K 

5. . Petcent ^non-white population ^ 

, a. Percent non-white-student enrollment, 1974-75. 

b. Percent non-w£ite student enrollment, 1979-80., 

c' Percent change; 1975-80, , 



4: 



District 



—Site 



6. Student achievement District Site 

a. Percent students below average in reading.., % % 

b# Percent students below average *in math % % 

c. Percent, students classes as "gifted" ; ; % % 

^Specify below the sources of the data used in answering these questions* 
Specify the kind of test^e.g., national standardized achievement tfes.t, 
statewide assessment test, local testing program), the name of the test, 
the source of the data (e.g., central office, principal, etc.) and what 
the "average" is' (i.e. national, state, or loc^l, average) . 
Sources, etc. « , ■ 



12 



V 

7 . Busing 1 

a. Percent of student bused into this site. 

b. Median distance in. miles that students are bused .... 



NOTE: " Items 8-12 concern school programs, organization^ and' staffing . 



8*. Time 



a. Time school day begins' at this site ? 

b. Time school day ends at this site..,. 

c. Total possible hours in school day... %^ 

d. -Number of periods per day.... 

e. Number of. periods attended by typical student.. ** ' s 

' ' . ' * 

f. Length of each period, in minutes .. 



9. Staffing - , ... 

Write in the number of teachers, not the percent, in each category. 
Give separate numbers for those participating and not participating 
in the field 'test. 

' ^ bistrict ^ Not part. . ; 

Males ' 9 m 

Females . ; x 4 

Race . 

.White 

/u, ' . . 

Black ..." .f^ . - 

Other (specify)/. _^ , . 

* Race and Sex . * „ ^ 

* s si * 

White males. ..... 

■ * v ' ' S 
White females.... - N . * 

Black males!. 

£lack f / j2itfal§p\ . . . ^_ <* 

Other males. I . . v » * ' : 

Other females.... . * 

Y jQ. Programs of study 

List below the areas or programs of study that students can specialize" 

in ;j at JEbe- site-? — After—eaeh-^ne^.incLicate "the enrollment in that program. 

Use another page if needed. - ' " 

Programs • * , ^* . .Enrollment 





11, Staff development 

» 

Abou^how many hours of in-service or* other staff development dd, 
teachers at this site get each year? hours per teacher. 

12 . differentiation ^ * 
Which of the following does this . district have? Circle YES pr NO. 



a. 


A .writ ten policy .defining* the jurisdiction and 










YES 


too 


b. 


Rules governing interdepartmental arrangements 


YES 


■ NO 


f- 




YES 




d. 


An organizational chart .(attach coj*y*if available) . 


YES 


NO / 



13. District plan 



What fs^the school district ♦grade' plan (e.g., K-4-8J K-4-4;-4, etc.)? 



14. Number of programs 

What is the number of programs and. positions formally .organized in the 
district, i.e., all the programs and departments in the districts 
organization chart? . 

15. FTE admini strators 

" + * 

Whiat is the number of full-time equivalent administrators assigned 

to- the programs reported in Item 14?' ; ! ' 

16 . Revenue spurces , 4 - 

»\\ 

List below the* revenue sources of Jthe district, in percent. - 
a. Federal aid......... % ' . \, 



b. 1 State aid. 



% 



vKH Local sources. 



«RIC \J£* 
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158 



164 



U- A** 



NOTE: the remainder of the items concern information abbut the county 
in which the site is located. If you are reporting^data for a 
city , rather than a county, check this box 

17, Population . 

a. Total popjilation, 1975.' 

b. .Total population, 1980 

* ( ~ * 

c. Percent change, 1975-80.... ; 

t ; 



18. Population density 

Population density, expressed as number of persons per square mile. 
^ persons per square mile. 

19. Urban percentage 

Percentage of population, classified as urban by census* bureau f m 

to 

20. Racial composition 

List the population, in numbers* erf people, as indicated. 

1975 1980 % change, 

1 a. White _j 

t b.- Black, ' 

* ^c. Other (specify) ' 1 



21. 'Competing agencies ^ 1 t ^ 

What is the number of public taxing agencies within- the county in 
competition with the school district for tax dollars? / 

22. , Wealth ' ^ 

For this item, wealth is defined as the total assessed valuation 
^ divided by the average daily attendance. ^ ^ 
a. Wealth of county, 1975 $ V . 



1 



\ 



b." Wealth of county, 198Q . ..$_ 



23. Tax rate 



What is the ^general tax rate per $100 valuation? 

< 

24. Non-education expenditures 

a. Total educational expenditures 

b. .Total direct expenditures for local government, 1980 

c. Ratio of a to b (i.e., a divided by b) l . . .\ . 

25. Transiency 

* * 

What is the percent of non-owner occupied housing in the 
county? t % 

26. Municipal expenditures I 
a* Per capita municipal expenditures, 1975 \ 

b. .Pet capita municipal expenditures, 1980 $_ 



p. Percent change, 1975-80 v % 

27. Unemployment - N 

What is the countylinemployment in' September, 198C? 
2*8. Public assistance 

What* percent of t:he county population is receiving public 

assistance in : <September, 1980?. 

29. 'Working families *" ' 
12 « 

What percent of the households in the county have 2 working 
parents?; % ; * * % ff 



■ ; 

Part 2 - Classroom Description Scale 
Complete this scalefor each classroom participating in the field test. 
You may need 'to consult the teacher or site administrators for some of 
this data. * 
1. Basic class information ~ 

A;,, a. Program title * t ' " ; ^ 



^0. Program goals or content^ 



c. N Total number of students enrolled in this cla^s ' 

d. Length of class ^ in minutes " ' 



e. Number of times per week class meets 
-2. Number of students * 



White . Black Other* Total. *$]iecify groups' below: 



Male • 
■Female 
Total 



E 



3. Home school 



Do any students in this class go to a "home scSool" for instruction 

j , * 

in the following subjects? Circle one answer to the right for each. 

a. Reading YES NO 

b. Mathematics * YES • ,N0 

,c. Writing YES NO V 

d. Listening and speaking. . YES NO 



\ 



J 



4. V Student test achievement * r . 

' Mathe- Listening 4 

Reading matics Writing & speaking 

a. * Class mean _[ " \_ 

b. - National, state, 

,or local mean - v # 

c. Number oTf students * ^* 

below this mean ' 

d. Source of data. Describe the sources of 'data for the information above. 

t 

This might include a nationally administered commercial test, a state- 
wide assessment program, locally developed tests, or other sources* 
Specify the test name and other information about it where possible 

Reading , 

Mathematics ^ - • , : 

Writing ^ 1_ 

Listening and speaking \_ - : » 

5. . Special needs students * - 

I 

Number of . -Vv./ * 

©students ' % * 

. • i \ . .... 

b . Learning problgps^ - a 



c.« Slow learners V. 



d« N Visually handicapped* • • 

e. Hearing impaired • • 

^ f . PhysicaL- handicap. . v ... . 

g. Other needs - specif 
belfry 
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FIELD TEST ACTIVITIES REPORT FORMAT , . 
«* Instructions for Field Test Coordinators 
and .Other Project St^f f 

The Field Test Activities Report Format is an outline to* Be used in 
writing memos which* report activities conducted by sites in association 
with, the Basic Skills project . Sucfo memos document .work activities con- 
ducted by site personnel in using the Teacher's Guide and the Rfesource 
Guide^ Report memorandums should^ be based on the direct, observation of, 
or participation in, . such, activities* by project staff/ < 

Field Test Activities Reports are intended to report meetings char- 
acterized by (1) involving several planning and implementation tasks, (2) 
involving one or more project staff members and all, or most, of* the. site 
personnel, and (3) being fairly lengthy^Cl-2 hours)** This contrasts with 
the Technical Assistance Contact Report whifch- generally reports contacts 

that can be characterized 5 ; as CI) involving strictly technical assistance 

■ v • v 

ion specific problems r (2) involving, a project staff member interacting 

' m 
'% with, only one, or a few site persons,' and ~(3> being fairly brief. 



The format is outlined starting on the next page. Notice .that- the 
report is written iri the form of a memo and requires a heading* as shown. • 
The TO: line is to be written exactly as shown. The appropriate! information 
is to he inserted in the other headings as indicated in brackets. 

In the, body of the memo, the paragraphs should be numbered and headed 
exactly ^s shown. Accompanying each heading in this illustration is a 
description of the intendjdbcontent of that paragraph or sub-paragraph. If 
there is no information to be given under a certain heading, put the heading 
in anyway^and some* explanation such, as "No /information available" or „ ,r Not 
applicable Never omit- a heading. Of course, the amount of information is 
not fixed. Some reports will 'be very brief, others may be 8-iO pages long, N 
depending 'on the. nature of the activity and\the information available/-,!^ 



» % - ... MEMORANDUM*^ >» 

TO:, Field Test .Director, Basic* Skills Project , Cornell Institute for 
Occupational Education, £onTell University 

FROM: [Name and" title of person writing, report] 

RE: Field Tfest Activity Report, [Site Name, Location, and Code Number] 
DATE: [Date report was writj^efrr- Hiot date of activity] ^ 



.'. ♦ . !• * Context ^Information % ^ 

„ a Date of observation . Date on which the activity being observed 

actually took place. 
\ b. Location . Specif Ic address where activity took- place, including 
district, building, and room. 

c. * Previous observation . ^Date and a very brief summary**^ the major 
outcomes of % the previous activity which, was observed. . Check. pre- 
vious report fox this Information, if necessary. 

d. - Major decisions, work efforts, or activities sines last report . 
Note any decisions made by materials users, or other persons^ which 
will affect the use of the materials in an£ wayi' who (position) 

_ made -them, and the Input and reaction to such decisions by materials 
, users. Note also any activities which, the materials users undertook, 
. ' or meetings- which- they had, at which- a project £taff member was not 
present. 

e. f Attendance* List below the names and titles of the persons* present ' 
.at this work effort;. / List also the names and titles of persons, who- — 

" wet*e scheduled to Be present but who were absent. If it is^rele- • 
vant to the report, note the reasons rox their absence.' . 

f. Special* conditions . Include here any remarks af>out the . conditions, 
physical /or otherwise, of the activity which mightrhave an influ- 

% ence on the Events. Conditions clfcx Include' physical facilities',/ 
in terruptions< distractions, etc. • • . . 

2 . ^Purpose . ' Lists the purposes, go^ls,. or agenda of . the activity which, was'. 
* observe*!;. Attach a printed agenda' i£ ; one w^ available. - 



V 1 . ♦ ■ * . ' . £ 

V 5 ' . ' • ' ' 

3. Activities? Tl£ts paragraph, presents a factual description of tKe 

• * ' ' - * 

activities, including incidents, event s", and remarks of the partici- • 
k • pants. This, should be a cpmpletey, though, not. overly detailed, de- 
\ scription. It Is the heart of the activities report. Use as many pages 
as necessary to describe the activities. <* * ^ ^ 

4. Outcomes . Briefly summarize the results, outcomes, ot; products which 
the work effort * produced. Copies of the products might' be attached to 

9 the activities report, if feasible. 

5. Technical assistance . Note anjr technical assistance or- interventions 
/ ^ Csuch- as specialized personnel, facilities*/ Information sources, etc.) 

•which, the Materials users turned to, or wanted to tunt to, to carry out - 
the use of the materials. This i-ncludes assistance given by Field Test 
Coordinators or other % project staff. Note alsp If they asked you for 
y * assistance or if you intervened on your own to "keep them on the track.'* 

6. * Problem summary. ' Summarize any problems wftich. th^lisers' encountered in 

trying, to use the material^. If „ you feel that these have implications 

for revising the guides, noteNwhat these- are. * 

7 'Morale . Describe your . impression of the morale of \ the participants. 

Dcl they seem ,to have a positive ajttyyzude? Are they confident or do they 
. * * . „ ~- , 

seefti depressed^or Sored with, their work- or with this project? 
rf » *" * »* 

. • 8. Materials revision . Was there anything to suggest . that the users could 

: * not' understand or use the materials- and instructions? Are there any 

changes, in addition to those suggested in Paragraph. 6,, which, you would 

# • suggest^making to the content of. the product based on your observations? 

\ 9. Other comments . ^ Indicate any other -observations or comments you have, 

> , , which- were notxovered above, and- which^may^be. r£Lat£d directly to the n 

..^ . evaluation questions. ' * . . o * ' 

1Q* Future events? - Indicate the date, 'locat&n/ apd tentative goals* of the 

. next activity* Or* ..work, effort. Describe any? Intended events ^ outcomes, or 

activities which- will tkke place Be^forer the Kext activity.. 4 * ^ - t 



' FIELD TEST <v 
N * 3ASIC SKILLS THROUGH VOCATIONAL EDUCATION* 



TECHNICAL ASSISTANCE CONTACT FORM 

— ■ ; \ 



This form documents contacts between Basic Skills Project staff and 
site personnel at which technical assistance is given. It should be com- 
pleted any 'time a project staff member is in contact with a user site per- 
son during, the field test. ♦ ' 
. . \ - ' ' 

Contacts to be documented oh this form are generally characterized 
as (1) invoiving*strictly technical Assistance on specific problems, 
(2) involving a project,, staff jnember interacting with only one or a few * 
site persons, and (3) being fairly ixXef : ' It contrasts with the Field 
Test Activities * memo which repo.rts meetings x characterized by (1) involving 
several planning and implemei^ation tasks, (2) involving one or more pro- 
ject staff members and all, or molt, of the site personnel, and (3) being 
fairly lengthy (l-:2 hours). 



This form, together with 'ptliers? will constitute a running' record 
for each sit$'.on what probl^jns^occur^ed in using the materials, and will 
describe the response .by the -, p£Wect'%taff to those problems. 



; Site name and location 



Site code \ Date . tfiis". form completed 

< ^ : ; ^ < ' ¥®Q> 

f '* * ** f, ~ - 

Person completing this form % * ; * ; 



[Piit-CIOE or materials logo'here] 



List. the names, of Basic Skills project staff involved * in* th^r contact. 



a. 



b . 



c. 



List the names and title or position of site staff involved in the contact. 



Type, of contact. Check one;, 
a . Phone 



b. Written. Attach copies of materials sent or received. 



c. Face-to-face . -^Where did the contact occuifc? 

- \ 



• ■ - . ■ . \ 

Who initiated the con£ac£?' Check one. 



a. School district staff 

> 



' b. Basic Skills Project staff. * Go to Item £. Skip Item 5;' 



> y , - 

What moved the school person^to initiate the contact? 

' a; Oil his/her own initiative M 

. . b. ^<3n another* person t s instructions/ What was that person's^ 



A] 



•J 



name and position title? ; ^_ >. ms ^ 



6. Describe the problem* ^Be brief but include, all dimensions of the 
problem. Use additional sheets^ of pa:per, if needed. Do not. write 
on the back of this page^ 



7. Describe the assistance and actions taken by Basic Skills Project 
staff. Include Such actions as giving factual information, giving 
spe^fic instructions, providing feed-back* analyzing the problem, 
suggesting solutions, providing encouragement,* and so on. Use \ 
additional sheets of paper, if needed. Do not, write on the back of 
this page . / „ 



r 



:0 



8. Was the problem resolved or the information totally supplied? 
Circle oae: . YES NO . . ,If not, why not? e 



9. Is.it likely that the problem or question will persist and require 
additional help? Check one. 



a. No. 

b. Yes. Explain why. 



ft 



10 • What was t;he school district person's attitude at the end of the 
contact? CheSk one. * . 

• a. Angry 

b. Frustrated 

'< c.v Neutral i# ' " 

d. Satisfied 



• e. Pleased and happy. 



11. Describe the immediate outcomes of the contact;, what conclusions 

were reached, what plans made, and so^on, as of the end of the contact*. 



r 



/ 
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12. Additional information. In the course of your discussion with the 

school district person(s), ypu may be. presented with, or create, the 
opportunity to elicit some -of the following kinds of information. 
Pursue this information only to the .degree that the subject appears * 
.responsive. Be sensitive to those points at -which the subject volun- 
tarily opens these areas, and probe. The areas are: 

a. Materials content and workability. ' 

b. Progress arid effectiveness of the teachers using the materials. 

c. Prior planning or implementation efforts. * ? • 

d. Resources for effectively using materials. 

e. i Group processes , group meiibers, and leadership. . ^ 

f. " Building- or district administrators, tljeir involvement', and 

actions. ** A 

g. Personal feelings of satisfaction, or frustration. 

h. . Other information significant to ttte project. 

< 

Recount this information in the space belpw, referring to the letter 
of the appropriate area above. 

• » 



IT'O' 
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Project staff - « 

James A. Dunn, Director 
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